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: - . INTRODUCTION ' , 

le Vocational-Technical Education Consortium /of States (V-TECS) 
was formed by seven states on July 1^ 1973, The fundamental purpose 

of V-TECS is to develop catalpgs of performance objectives and 

. . • . , >, . . . . . ' 

criterion-referenced measures in occupational education. V-TECS 



is developing objectives based upon a uniform procedure consisting 
of: (1) development of task statement booklets by a domain of 'job 
titles^ (2) selection of a representative random sample of incumben^ ^ 
workers within the^stAte which is developing the c^alog^ (3) admin- 
istration of the task statement booklets to ttie incvunbent worker 
sample^ (4) computerized ajialysis of information cojClected from the 
sfiunple in terms of ' time spent on tasks ^ dif4i<Julty of tasks ^ etc./ 
(5) conversion of the task statements into performance objectives " X 
with companion criterion-referenced measures/ and (6) a comprehensive' 



EKLC 



field test and dissemination program. , . 

Policy matters of V-T^!CS are handleci by a representative Board 
of Directors composed of one member from each participating state 
who is appointed by the State's Director of Vocational Education, 
^he Community College of the Air Force is all associate member due 
to their accredited, status with the Commission on Occupational 
Education Institutions and their expertise in perf ormanCe-based 
instruction. 

A central staff is provided by the member states to coordinate^ 
m'anage^ and provide technical assistance, to all states developing ' 
products for common use by the members. 



4^- 



The^VcJcational-Technicay Education Consortium of States is an . . 



operating u^t of the CommissyDn oh Occupation^^J^O^ation instftu- 
tions, Southern'^ssociatiori of CoJ.leges and Schools (COEI/SACS) . 
COEI/SACS is a private non-prpfit organization which has as~^t9 . : 
purposes: (1) accreditation of institutions elig|.ble for member- 
ship, (2) gener^, evaluation activities, and (3) research activil^^s 
related to the first two' purposes . » • 

Th»s report cQvea» N.iihe progress of the Vocational-Technical: 
Educaiufon Consortium estates through its first seven months' of 



Qpera^ion, ^nd is designed to provide information to member states, 
prospective members, and interested agencies, organizations, founda- 



tions, u.s.o.e;. 



etc, 



/ The First Progress' Report of the Vocatiojali ' Technical Eduction 
Consortium of States v/as reviewed and approved by the Board of Directors 
of y-TECS on March "), 1974^ 




N, 
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VrTECS BOA-RD MEMBElfS AND/^UMMAR I ES OF MEETIf^S 



A. Members of the Board' of Directors 



vice Chairman: 



Parliamentarian : 



Executive Director; 



Ex Officio: 



nt. Robei^t Spillmath,/ Director 
Personnel Development Unit 
Bureau of ' Vocational Education^ 
2035 ^Capital 'Plaza Tower ^* , 

J Frankfort, Kentucky 40601 

Mr. Paul Scot t# Director 
Occupational Research. Coordinating Unit 
State Department of Education ' ' 
Room 250^'' State Office Building 
Atlanta, Georgia 30334 

Dr. Roy Giehls, Consultant. 

Bureau /)f Vocational Research ^nd Evaluation 
Room 254, Knott Building, , ■ . ' * 

Tallahassee, Florida 32304 

Mr. Ben A. Hirst, Jr., Executive Director 
Vocational-Technical Education Consortium of States 
Southern Association of Colleges and Schools 
795 Peachtree Street N.E. / ' • • 

Atlanta, Georgia 30308 

Dr. B. E.Childers, Executive Secretary- 
Commission on Occupational Education Institutions 
Southern Association of Colleges and Schools 
795 Peachtree Street^N.E. , . , 
^Atlanta, Georgia (^QPOS 



Alabama 



Member 

Miss Ruth Stovall, Branch Director 
Program Services 
Sta-^e Department of Education 
State Office Building 
Montgomery, Alabama" 36104 



, Altjgir nate 
— r^- ■ 

Mr. James. Kendrick, Curriculum;. 

' Specialist ^ 
State Department of Education 
Room 855, State Office Building 
Montgomery, Alabama 36104 



Florida 



Dr. Roy Giehls, Consultant 
Bureau of ^Vocational Research 

and Evaluation 
Room 254, Knott Buildi^ng 
Tallahassee, Florida 32304 

t 



• Dr. €. Virginia Bert 
Acting Administrator 
Bureau of Vocational Research 

and Evaluation 
Florida Department of EdWation 
Tallahassee, Florida 323^4 
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Georijia 



Membefr 
Mr. Mit 



<!r, ¥4rtir Scott, Director 
Occupational Research Ooordixikting 

Uni^t • - , • ^ ^ 

State Department of Educa'tioa 
Room 250, State ^Offic^ Building 
Atlanta7 Georgia 3033.4 ^ 



Alternate - , . 

* K • ' 

Dr, Gene Bottoms, Director ^ 
Division of Programs and Staff 

Development 
State Department o^ Education^ 
Atlanta , Georgia 30334 



/ ^ Kentucky 

' Mr. Robert Spillman, Director 

Personnel Developanent Unit 
'Bureau of Vocational Education 

2035 Capital Pl^za^ Tower ' 

Frankfort, Kentucky 40601- 



Mr, Charles D, Wade> Director 
ProgrcUrti Development Division 
Bureau of Vocational. Education^ 
Capital Plaza. Tower 
Frankfort, Kentucky 40601 



Mississippi 



Dr. James E. Wall, Directpr\ 
Research and Curriculum Unitt . 
^Missii^sippi State University 
Drawer DX 

State ^College, Mississippi . 392-62^ 



(New alternate to be named*)* 



V 



Texas 



Mf^. W. H. Fitz, Educ/ational 
ProgrcUnyjDirector 

Office of^ the D^eputy Associate 
Commissioner for Occupation" 
Education and Technology 

Texas Education Agency ^ 
^01 East Eleventh Street 

Austin, Texas 78701 ' f 




Mr. Joe Tokash, ConsulJ^ant. 
Office^ of the Deputy Associate 

Commissioner for Occupational 
^ .Education arid Technology 
Texas Education Agencys 
201 Eastjei^venth Street 
Austin^ Texas 78701 



Vj.rgihia 



Mr. l\ M. Jewell, Coordinator ' 
Vocat'd)bnal Education Research 

and *Sf^fr&tistical Information^ 
State D^pfartment of Education 
Richmond/ Virginia 23216^^ 



1 




Dr. J. Dale Oliver, Director 
Vocational Education Evaluation. 

Project ' ^ ( 

Division of Vocational, and 

Technical Education 
Virginia Polytechnic Institute 

and State University 
Blacksburg, Virginia 24Q61 
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' '.. r • ' ■■ ' . ' . ; 

Associate Member Non-Voting : ) / 

'1 — ^ — — 

Member Alternate 

Capt. Robert tf. Chllds Ut. Col. R. N. Culbertsbn \ * 

Pro£esslo|ial Relations^ Liaison Chief, Liaison Division - Stop 28 

Division Coropiuhity College of the Air Force 

Community College of the Air Randolph Air Force-B^se, Texa? 78148 

.-^^^^^-Sorce * . 

RandblWi Air Force JBase^ T^xas 78148 _ ■ ; 

B. Summaries and Dates of V-TEgS Board Meetings . . 

(1) ! First V-TECS Board Meeting ; August 2 and 3^, 1973^ 



This meeting was held in Atlanta, Georgia for ^he^purpose 
of initial planning and operation of the Vocational-Technical ^ 
.Education Consortium of States. Seven #tates were represented! and 
the associate member, the Community College of the Air Force. 
Special guests attending were Mr. George E. Wallace^ Regional 

* . . ' i ^ . 

Director, Adult/ Vocational, and Technical Education , DHEW, | 

Office of Education, Atlanta/ Georgia^ The primary objectives 

of this meeting were'io: (^) elect , officers , (b), receive a report 

of the activities of the Executive Director of 'v-TECS, (c)- consider,. 

and revise the recommended budget In terms of the seven state member- 

ship, (d) discussion of a name for the new ^nsortiiim, (e) copy- 

righting^ of materials developed by V-TECS, (£) ^ contract for the.' 

,^_90l!iputerlzed aspects of the V-TECS procedureis where computerization 

-appears to b^-^en^^iclaly and' (g) a large j^nvitatidhal conference 

for presenting the trends toward performance-based instruction, ^ 

and the approach to be used by.V-TECS in its effort* - .3 ■ 

J ; - . ■ . 
(2) Second Board Meeting , Septe|foer 5_, 6, and' Ti' 1973 * 


This Board meeting was held in' Blloxl, Mississippi ♦in -conjunction 

* » ■ 

with prelimi^M^ft-lanning for^the Instructional Systems Design 
Conferertce to^ co-sponsored by the Commtfnity College of the Air ' 



* Force, the Southern AsBOciation ot Colleges and iScjiools, the ^ 
' Coiranission on Occupational Education Institutions, and the Vocational 
Technical Education Consortium of StatelB. The Conference was ihosted 

by the U. S. Air Force School of Applied Aerospace Sciences, Keesler 

\ \ r . . ' . . V 

Air Force Base, Biloxi, Mississippi. ^ ^ 

Other major items of business discussed and accomplished during 

this meeting were; (a) development^ of a brochure and public ir\forma- 

(tibn program for V-TECS^ (b) discussion and adoption of a revised 

' dperating budget, (c) a contjract for a National State-of-thte-Art 

Study ^^iJij^ .conducted by th^ Educational Testing Service, Princeton, 

NeV Jersey, (d) th^ role of the technical coordinator in each state, 

(e) development ot a Memorandum of Agreement to control and manage 

pi^iict development on edch project in each state, (f) discussion 

and 'development of operating Byjaws, (g) discussion of proposed 

management model to be "developed using a^elect€(d Jury of Ejcperts 

employing the Delplxi te^niqul, and (h) discussion of priorities by 

state for catalog development. ^ 

(3) Third Board Meeting, October 8-11 , 1973 

The third meeting of the V-TECS Board of Directors was heJSJ 
in Biloxi, Mississippi during the Instructional Systems Design 
jfonference at times when members were available. Major agenda 

items were: (a) a ' sample, design to be used by V-TECS for sampling 

' ^ - ■ ^ . ^ • 

incumbent workers in, each catalog^ area assigned to the States, 

(b) activity repprt of the Executive Director, V-;^ECS, (c) review 

and selection of a Techifical Specialist for^ the V-TECS. staff, 

(d). p:rpf essional and technicaT developjj^nt program, for V-TECS 



V v ' ■ - - • ' 

staff and personnel within he member 3tates, r^^F determination of ^ 
Consortium* pr^^oirities and assignment of catalogs to b^rteveloped, 

(f) limitations oit^-^lie sample design to survey incumbent workers 
within the state^ deviioping ^a catalog and the, use of a purposive 
samjile design should other states questio^i the survey results, 

(g) refinement and distribution of the Memorandum of Agreement, 
and (h) a Coding system for materials ,deve loped by the Consortium 



(4) Fourth Board Meeting , December 5, ' 1973 

This meej:ing of the Board of Director's was held in Atlanta, 
Georgia in the conference room of the Southern Association of ^ . 
Colleges and Schools. Primary itepis of business accomplished v. 
were: (a) a strategy for the involvement of special groups during 
the survey of incumbent workers such as independent garage owners, 
professional organizations, unions, management organization,, etc, , 
(b) discussion of the Consortium copytighting policies, (c) plans 
for a two-day workshop for feechnieal coordinator? concerning survey- 
ing incumbent workers and sample design," td) report of V-TECS Staff 
activities, (e) discussiop ^^d setting of membership fees for new 
states wanting tp^oin V-TECS, (il* discussion and distribution of 
the <j:ducatipnal Testing Services' State-of-the-'Art ^ Ren6rt (first 
draft) , (g) discussion additions to the backgroujfd information 
section of the task statement booklets to be used for surveying 
the incumbent^s/orker, and (h) the role and scope of the project 
directors in each state. 
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^ \ .\ r * 9 • . , 

^•v Board ot Directors , lutings ^for Remainder i df the .|ear * • . 

•the Board 6f MEgc tors meet "in Atlanta, Gjcor^ia for 

' ■ - -•» " > ' . * ■ " " ' ■ ■ 

regular business ^^ess'i»ns. fen March '6 and 7 and -again -during the , ^ ^ 

• - '0 V ' ' ■ . . •' ••' 

f irst V^eR In ^ay^» •.CAotual, date to, be.Vset by the.'^CHairman of^ tbe ^ < 

BoarcTand. the -Exec?|ibj.t>^e Director.) ^ ' ' , ■ ' / ■ / 

, -V . . ' " ' ■ ' - 

.* . " ^ :. * " - ■ ' ' . 

: dV ■ .Bylawa^ of V-'fECS * • ^ > ' / - c 

The -Consortium has developed a set of Bylaws for its operation. 
• Means -have- been included to change the B^laWs and to otherwise 
modifV" the operation, management, and conduct of business of.V-TECS. 
Appendix, "A" (blu^ paper')' of th-is report contains the Bylaws 
presentiy being used by V-TE'CS* r 

• .... * • ' . ■, ■ 

' 1 1 . DEVELOPMENT OF AN OPERATIONS AND MANAGEMENT MODEL 

V ■ 

According to research^ onig^ of the primary problems confronting 
Educational Consortiiam activities (and some "other cooperative efforts 
in Education) hafe been the lack of a clearly-stated an&- well-defined^ 
method of managing overall opej;;^ions. This problem has occurred 
because of a general lack of focus on the real goals and objectives 
^ of the cooperative efforts and developing .means to bring focus to 
these goals'. The Vpcational-'^chnical Education Consortium of* States 
(V-TECS) recognized this problem and has initij^ted an effort to 
develop^ over the past fourteen months^ a comprehensivej^anagement 
model. The narrativg portion of the model and- a sequence chart 
are included as Appendix "B" (green paper) at the end of this report.' 
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A.' Methods tJsed to DeVeldp^the Mana^ment Model 
- - "^^ifT XStudy of Bigievaht Coo^^rativej Efforts ^ • \ 

A, cataprel>exi3ive search of the literature and perkbnal ^inter- 
views with leaders in the., field of perf orxnknpe-based instruction 
4^sulted in -the •jj^entification of seven cooperative efforts using 

various sorts of rcbnt role fey steins ^ The most' de'sirable activities. 

. • ^ r ^ - y . ' ^ . * ^ , ■ 

of tJtl^^ •programs included in the study' wer6 selecrted^ reworSed^ 

* ■ * " - ' * *» 

' reseqiieftcedr ayd supplemented to form a basic model for use by 



V-TECS. , 



(2) . Selection of a Jury of Experts 

A national Jury of Experts were asked to serve as a panel to 
react to^ refine^ and sequence the activities to be used in the 
management model for V-TECS. The Jury was selected from persons 
wh6 supervise^' administer r> research^ a^d otherwise direct 

programs of curriculum deivelopment and instructional imprWement. 

/ Si 

List of the Jury of Experts\is included as Appendix "C" (gold paper), 

' (3) Instrumentation and Scales * 
/ ' The instruments and scales^ used were similar to and, modeled . 
after a study conducted by t;he^ Educational Testing Service for the 
Nc^tional Laboratory -for High^ Education entitled^ "Institutional 
Goals Inventory." * . 

(4) Administration of ^he Instrumentsl H > ^ ^. 

^ The instriaments we^re administered using the Delphi teBHij/qU^ 
and incorporating three probes of ;the Jury of Experts. The results 
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we'r^ comE)U^rized .and consisted of a tho^ugh analysis of- response's'- • 
in terms of the mqde^ until f IS percen^^ncurrence: was obtair^e'd.^ 
■'internal consistency" was calcuUte^^ for each instrument by in^j or 
activity." In. addition* the first two probfeWncluded a' sej^iiencin^ 
question which resulted in_^98.1 percent concurrence by thirty-six 

meiftoer Jury of Experts. ^ ' ^ * 

' ■ . ' . . , " 'i 

■f' \ ' ' " - ' ' ' ■ 

B. Results of the Study ^ * . ♦ 

— : ■ / . . 

■me final Delphi probe is being processed. 1h& results of 



the study will be reported to the Board of Directors of V-fECS and 

■--5, , / 

used either in its recommended state or modified to suit the desires 

of the Board. The total stud^f and recommendati<!lKs should be complet^ 

and reported to the Board of Dir4ctors of V-TECS by May 15, 1974. 

The Board of Directors has adqpt^ cert*ain portions of the develop-' 

mental model for implementatiq^ prior to its completion. 

■ ill. PROFESSIONAL DEVELOPMENT OF STAFF 
AND TECHNICAL COORDINATOR'S 



1/ ■ ; 



, -<^A series 'of five workshops~liave been conducted and/or planned, 
during the first ye^r for V-TECS Staff and -the Technical Coordinators 
in -the member states. The activities have been designed to develop ■* 

certain technical competencies dealing with occupational suifveys, 

■ J- . 

research, writing of task statements, and writing of performance 
objectives with companion criterion-referenced measures, Insofar 
as possible, the workshops hav^een timed to prepare consortium • 
personnel in technical areas in keeping with the stages of develop- 
ment of their assigned catalogs. In each case, some overlapping of 



t 



previous workshops' has occurred to refresh, oir emphasize pribr^ 
technical training. .T^he workshops h^ve^ been conducted on the site . ^ 
where' the. desired technical comBietericies were being utilize^ so 
, that "hands on" experience and first hand observation could be 
.maximized. A copy of t^^fi? -program for the instructional System 
^ Design Conference ^is included as Appendix^^'D" of thisyfepprt. 

ft. Oriefltatioil to Instructional System Development and V-TgCS 
•, V ". Procedure's , Keesle^ Air Force^ase , j|HLoxit. Mi^issippi 
V ■ ' OctoheFT=12~ r p>JT ' \ " "J* . j: 

An instructioncil Sy^eitfe Design Confferenc* wai held at / 

Kee$ierAFB, ■ Mississippi, in which performanae-based instructipn 

and its inherent philosophy ^we'^key, agenda topics. This , 

conference served as an orientatioi^phasfe f(Jr the Consortium 

^ staffs technical coor(^inators ^ and Board of Directors in the areas 

of systems design an^ the V-TECS occupational analysis ^^^r am. 

' Performance-based instruction was observed and discusseo^p seminars. 



I 



Specific Objectives of the Conference were to: 

(1) Provide an orientation to V-TECS procedures for develop- 
ing ^catalogs of performance objectives and criterion-referenced 

measures. ' 

' Observe and participate (on a limi^bed basis) m the 
development of performance-based instruction as conducjted the 

' r 

U. S. Air Force. . , 

(3) Attend general session presentations by experts j.n the ^ 
• iPieW of occupation^ occtipational^'surv^ying 

evaluation/ educational accountability^ instructional systems design^ 
^ and occupational analysis. 

16 
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B. Professional b evefopment Workshop , LaGklartd ^ ^ir Force Base , 
San^AntonTo , Texas , November 12-^16 , 1973 'f 

The Professional Development Workshop was held at the 

Occupational J^asuremertt Squadron. The m^in ob^eatives of the 

workshop were tO' develop skills for the technical .coordinators 

arid . consortium staff in conducting domain ^studies, planning and 

seguencing project activities, meeting reporfe^in^ responsibilities, ^ 

and locaJing and s^nthesi^irtrin^^^ for developing task statements. 

'The participants also g'aija^d the. experience' in actually^ writing task 
statemert'ts ,and occupatibnal interviewing, jfln' introduction to the 

/^processing ^nd analyzing of oocupational data and basic sample 



pesign was presented. 

Recognized national authorities in the field of occupational 
measurement, occupational analysis) interviewing of job incumbents 
and educational research participated in this intensive eight-hour 
per day training activity. This workshop provided the basic skills, 
to begin the development of catalogs of performance objectives 
according .to V7TECS procedures . 

C. Sample Design Conference ; January 10-11 , 1974 , 
Atlanta , Georgia ^ 

^ The Sample Design Conference, conducted in Atlanta, Georgia 
in January, 1974, dealt specifically^ with the V-TECS data analysis 
program and the design of input data. Seminars were held on task 
booklet format, population framing, instrument design validity^ and 
specifications, and' the follow-up of non-respondents. An orienta- 
tion Was given on the development of performance objectives from 
task statement analysis. 17 
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Saijiple design experts from the Educational. Telting Service, 
Princeton, New jersey and selected ^^ons in . the Occupational 
Meas,urement Squadron of the U. S. Air Force Air Training^ortimand^ 
served &s resource consultari1rs--for_the^ontent of this meeting.- 
A. sample design handbook developed by the V-TECS^ staff was distri- 
buted and ex^ained durfi^^f|.s activity. ^ * 

D.. 'Professorial Development Worjaphop , '^ Randolph Air Force Base , 
^ .'• ^ San Antbiilo , _ Texas , March - 26-28 , 1974 ^ * 

\,,.B2:ans have l)ee^ completed for. a Professional Development • 

Workshop to be held in Sari An t|||io, ' Texas , to develop skills' in 

converting task statement- analysis data into performance objectives 

and -criteriori-ref erenced measures. The implications of occupational 

survey; data for training strategies, interviewing incximbent workers, 

and procedures for keypunching and forwarding ijiput data will -also 

be discussed. An overview of the selection and preparation of ; 

writing teams withijst; the member states will be presented. 



I 



Expertise will be utilized #rd>m personnel of the U. S. Ait Forqe, 
Air Training Command who. have been \^^ifig for several years -in the 
field of occupational measuremeritr occupational analj^^ and writing) 
performance objectives. V-T^CS staff mefnbers will present informa- 
tion on the format for inpat data resulting from surveys of incumbent 
workers. In addition, the problems related to. and procedures for • 
the selection and. preparation of writing teams will be an important 
ic of the^yterJ<;%ho^ - . ^ , : ' ' ■ ' - 
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E. Professional Development Workshop > June, 1974 , AtlantaT ^^orgia 
This workshop will be designed to discuss and resolve problems 
encountered w^iie utilizing and managing writing teams. Developing 



the format of the* cata'logs , including the coding of performance 
objectives and 'cf iter foh-ref^renced measures, will consiame a ma jot 



part of the time. Opportunity Vill be^provided ^11 ^e^nical per- 
sonnel attending to interact and. to share experienc^ts^ which have' been 
beneficial during the development of perfopnance ^jectives and 

■ ■ ' ' ' r ^ \\ 

criterion-referenced ' measures . 



The technical coordinator in each -sta^e has been identifieij^ 

as the prime person for training and otherwise prep^arijig^ersonnel 

to accomplish, the task's e^umeralfed in the Professional Development ^ 

Workshops.- (See Appendix "E" (yellow paper) for a descriptiop o*f 

the role of th^technical codrdinator . )^ A Technical Speci^st is 

avad,lable^on request, from ^he central staff of V-TECS to assist 

in sKlcial problems of training, preparation, and all other 'technicat^ 

aspects of the procedures used to develop catalogs. 

I . ■ ■ > i 

IV. STATUS OF CATALOGS UND&» DEVELOPMENT 
!> • AND PROJECTED COSTS . 



^A. Projects Under Development 



Listed below are the ~ii^talogs under development in the 



/J 



member statefe: 



state 



U.S.O.E, 
Code 



Areas 



Alabama 



17.1500 Electronics Occupations 

17.01 Air Conditioning^ 
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State 



U.S.O.E. 

Code 



Areas 



Mississippi 1/17. 1001 Jk 
^ 1.0504 



Pltunbing (Building 
Landscaping 



Georgia 

4 



Florida 




v/rginia 



1 



Texas 



14.02 
17.2302 



17.0301 
' 01^506 

07.0101 
04^06 
i7ri 
1. 

14.0105 
. -.09.0201 

' * i4:otoo 

^ 09,. 020?. 



17.3203 
16.0605 



e/: 





Dat Processing ] 
Production Machine O 



Body & Fender 
Turf Management 



Dental Assifetai^t 
Food Distripution 
Carpentry 

Agriculture Pow^r & Machinery 
Teller 
Child Care 

^teno & Related and 
'ood Management, Pr 
Servi4^s 



■mter Management 
Police Sftbieace Technol 




All catalogs under development are cont^bi^led by u^^&f a 
Memorandum of Agreement between the State and; .the BcJard of Directors, 
of V-TECS. The project cont^roi^hart--Appendix "F" paper) 
— specif ies^^he products and reports to be furnished and the dates 
they are due''. The date on which the Memorandum*^© f Agreement is ^ 
signed by each state determines the product delivery .schedule . 
The Memorandum of- Agreement e:^lains' and sets forth ot^er quality 
control measures used by V-ffECS and .tli,e member siiates. 

> 

Projected Costs of Catalogs Being Developed 
s Each participating sVate in V-TECS- seleots- and employs a 
technical coordinator on 4 full time basis .to serve as- the resource 
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Range of CMt: $15,303.00 to $39,308.00 
Total Average 
Cost: $31^024.52 

21 



Figure 2 illustrates thfe average cost of catalpgs under development 
in the member states but doeg^ not reflect the cost of the technical 
coordinator jshown in Figure I; These costs reflect the tiel^ work, 
writing t^ams, isurveys of incumbent workers and qther pertinei\t 



developmental actJivities. 



Figure 2 - Projected Field Development Costs fpr Catalogs 
(Average Cqst Consortium-wide) 




Average Field 
Costs: V $15,098.00 



Figure 3 '^illustrates the total average ' costs of eacK c^^a|^g under 
development. The costs shown in Figure 1 are divided between Ihe • 
catalog development projects in each state and this division is . 
reflected in figure 3. / 

Figurfe 3 - Projected Total Costs\for Each Catalog Under Developm ent 
Including Costs of Technical Coordinators and FieT 



IS eluding Costs oF~ Tfechnlcal Coordinators and Fie ld 
Devferbpment CQsts ( AverageTCosts Consortium - wide ) 




< I 



SALARY, 





1 




\ TRAVEL f 






I $2,287.45^ 






V , -7.47% 







OTHERT^ 
COSTS 

$3,612.20 
11.8% 



INDIRECT 
SUPPORT 

$3,400.39 
11.11% 



CLERICAL 

SUPPORT 

PERSONNEL 

$4,974.33 
16.^5% 
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Average Total 
Costs: $30,610.26 

Information is- being collected on actual costs of eac°R activity 
and, sub-activity included in the model— Appendix "B" (green paper) 
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of this' report. Time r6qui:^ements will alsjo be reviewed and studied. 
AYter both cost="Sriti' time figures are ^lcu3|^t^d, the sequence chart 
in Appendix "B" (greenf^aperj^ will be devei^ed iht^^#, PERT network. 
Thi^PERT network will\be utilized to- inprove efficiency of catalog, 'j 
development and for cost/ef f ectiv'enetes sWdy. . * 



V. COriTRACTS AND QpOPERATIVE^FORTS WITH • i-^ ^ • 

, • OTHER AGENCIES, AND, INDIVIDUALS • . • ^ / 

— : . ' ■ ^ ^ -A ^ ■> • . ■ \ 'Hj "^ 

A. ' Conttjracts with . Other Agencies ai>d Individuals - ' • , \ f - • 

- — ^ ' . . <^ ' ' ■> 

'During the past sfeven months several qcc^sions.have arisen- 
- ■ " '•■ ■ ' . ■■ ' ■> ■ ' . ' 
which have r.equijfe«j outside assistance and expertise. The nature 

^^f these contracts has £een b6th sho^ term, and lon^ term. Follow- 
ing is a brief' description of the con^lgacts and names of the agencies 
and/or individuals used during, the seven-month period covered 1^ this 

repoi^t: ^ V 

(1) Educational Testing Service , Princeton , New Jersey 

(a) ,This organization was contracted by V-TECS to'undej:- 
take a nationail State-of-the-Aijk Study in the area of performance- 
based instruction. The contract required an overall search of 

n ' ■ 

material«-3lready gathered by ETS and additional reviews of • the 

literature, resource^ilaip, 'etc. Those efforts w^ich met a criteria^ 
set forth by V-TEC&fwere used to Compile and develop the resulting 
report. This document is being utilized by project personnel in 
feach state. ^ ^ 

• - ' ' ■' 

(b) In addition to the material developed under (a) , ETg 



assisted in the technical development of the sample design used by 
V-TECS to survey incumbent workers. A staff member of ETS presented • 



a paper on saiipliag jae^ign" and served as a re^^rce €o^h|/v-TECS 
Btafl. - . - , ^ . ^ 

■ , ''V , • ■ ' ■ ■ ^ , 

(2) Nashville State Technical Institute ^ 120 White Bridge Rqad ^ 
^ Uashville ^ Tennessee ^ ^ . pT" 

Thi^' institution has developed 6<Knputef^ programs tinder contract 

with V-TECS, tp provide desired reports afid Statistical an^yi^is 

resulting from the survWs of incumbent workers b;^^j»exnbe]6^tates. 

A Computer program ws^s'^^^erationalized, in Nashville \5tate Tec^iqal 

institute for gen^era^ing random numbers tto be ifted by^^tatei^ during 



saunpling activi^^ies,. 



(3) Individual Consult ive 'Services 



Individu'ti consultite work has been accomplished by: ' 

-, .^3 . ■•■ ■ ^ ■ ^' 

(a). Dr^ Tony Hj^isbnr Director of Planning • • 
Winston/Salem School System ' . ' 

Wington/Salemr North Carolina ' 

This person provided technical a^sistanc^' for programming 

the computer to analy^4 results frolh the Jury of Experts. The ^ 

service- included advicJ and assistance on the analysis of the 

data. . A program was written to establish the ini;ernal consistency 

of the response m^e ,by the Jury of Experrs in the development of 

the Vr-TECS mode3r--^ppendix "B" (green paper)-- -of this report. 

\ . ' . . 

' ' (b) Mrs. Linda Kemp^ Research Librarian 

• Texas Educational Agency 
Austin r Texas 

A'-presentation and workshop activity^ w&s developed which was 
designed to prepare the 'technical personnel within^ the states 




beldngirfg to V-TECS,. The activities ^prepared the technical - ^ 

personnel to effectively^ organize ^nd conduct, their State-bf- 

■ - , ^ f ■ . ^. ■ r 

, the-Art studies. The presentation and subsequent activities were 

' ^ ■ ■ • • . . ■. 

^ a part of^ the professional development activities of V^TECS. 

(cL Dr. F. Reid Gr^ech/ Research Psychologist' 

'Educational^ Testing Service c» ^ 

/ * ^ . " Princeton/ New Jersey 

Dr. Creech assisted V^TECS in the development of its sampling 
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design and other problems corin^Pcted with the surveying of inciombent 
'"wojrkers^ He* presented papers to the Board of Directors concern- 

posisiSle sample design andli^ade recommendation^ for the Board's 

- , . ' ■ j ' • i ■ , ^ ■ ^ , - 

consideration . , 

(d) Mr* Jcunes ^. Marable^ Head^ ; 7. 

^ Data Pxbcessing Technology* * 4 

''==="^^.BKshville Sta»te Technical Institute ■ 
^shvillQ,- Tennessee 

Mr. Maraible^'has assisted in the conversion of. Air Force computer 

programs Used for occupational analysis to progigfans which are com- 

patible wifth the 360/30- IBM Computer located in Nashville. He has 

also assisted and directed the development of a*' random numbers 

generator program for use in the surveying of incumbent workers by 

V-TECS. Other activities will include a- conversion to a larger 

system for handling l^torage and fast retrieval of data by V-TECS. 

Mr. Marable is also preparing a computerized PERT system for the 

activities involved in catalcrg development. This program will assist 

=..:V--TECS in identifyij^ high cost and high time-consuming activities^ .. 

, so that they can be l^adied and improved. ^ ^ 



(e) Mr. Elijah Hall/ Syatemi? Analyst • 
Data Processing Technology 
Nashville State Technical Institute 
Nashville y Tennessee. 



Mr. Hall provided thej technical-assistance and direction for 
the development and iirtpleraentation of computer programs /for V-TECS. 
All systems analysis work accomplished and/or directed by Mr. Hall < 




' (f) Mr. Pat Butler y Administrative Assistant ^A , 
to the Director 
Nashville State Technical^ Institute * 
Nashville y Tennessee v • . 

Mr. Butler was utilized by V-TECS to assist in the formatting 

of computer printout for occupational analysis ^ for statistical 

input and -for assistance in the development of the randoij numbers 

generatiifig program, Mr. Butler has' had intensive experience in 

occupational analysis with the U. S. T^rmy. 

B. Cooperative Efforts with Other' Agencies • ' 

Several people and agencies interested in the concepts and 
practicalities of perfbrmance-based f.nst3niction and with experience 
in occupational analysis have provided V-TECS with considerable 
voluntaxry time during" the past feyr months*. Following is a partial 
list of*^agencies and people who have contributed so freely of their 
time and expertise'. The list doeg^/not include everyone but does 
include the primary contributors: * ^ ^ 

(1) Southern Association of Colleges and Schools ( SACS ) 
Dr. Felix Robb^ Mr. Ross Tucker^ and Mrs., Katherine Byrd have ^ 
been particularly helpful during the initial phases of developpient 
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Of v-TfECS, Advice and counsel concerning .^ifd^ Space ^ leaders 

in the educational field and public rel^afiions have been^ notable 
contributors of this group of people and. the Southern Association 
as a whole. 



(2) Commission 'on OccupAtional^ y gxaucation Institutions ( COEI ) 
Dr. Bob Childers, Executive*; Secretary , and the Executive 

Committee of COEI have been q.uite~ helpful \ in of fering, advice, 
counsel and primary administration to the Consortium. The 
Commission has allowed V-TEG^ to use its reputation asS- leader 
in -the aiff^irs of Occupational Education to further and supplement 
the efforts of V-TECS. This .service and assistance was- invaluable. 
The Research Committee of COEI "supported, endorsed, and advised 
the staff of V-TECS concerning efforts! to be undertaken. 

; • . / V ■ 

(3) The Community College of th± Air Force (CCAF) , Randolph 

Air Force Base , Texas 

This institution has provided unlimited assistance to all 
V-TECS efforts. Support by the Pcesident of CCAPv Col. John Phipps 
and the Liaison Division have befen particularly helpful in managing 
the overall Air Force effort and have provided personnel who have 
'both ^he experience and desire to assist V-TECS in its efforts. 
The'cCAF efforts have included arranging for a broadly-based 
Instructional Systems Design Conference attended by more than 150 
leading educate!^, and participation in V-TECS Board Meetings. 
These efforts have oriented the Board to some of the methodology 
used by the Air Force. CCAF has also provided assistance in the 
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professional development and training of V-TECS technical personnel 
in the member states and the V-TECS staff; and last but npt least, % 
CCAP is an associate non-noting member of the V-TECS Board of Dijs^ctors 

(4) . Occupatipnal Career Developmgnt Branch , Occupational 

Measutemint Squadron , LackJand Air~orce Base , Texas 

Lt. Col. Lyle Kaape, Squadron Commander, Dr, Walter Driskill, / . 
and members 6f the staff have assisted, significantly in the technical 
preparation of .pe^stohnel in the' member states and the y-TECS staff. 
This assistance continues to be utilized^ and has been the basis for' 
initial "planning -dnd development of the occupational analysis system 
adopted by^V-TECS. Dr. Driskill and his staff have provided extensive 
assistance in V-TECS research, development, production of task state- i 
ment's, background information, and task booklet utilization. 

(5) Occupational and Career Development Branch, Personnel ' 

Research Division , Air Force Hximan Resources Laboratory , ^ 
Lackland Air Force Base , Texas 

Dr. Raymond Christal and Dr. Wayne Archer have provided tech- 
nical assistance concerning the research aspects of the occupational 
analysis system used by the Air Force. In addition, ^hey have been 
instrumental in assisting personnel from V-TECS and from the Nashville . 
State Tech^iical Institute to ad^pt the computer programs for the • 
use of member states. . 
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VI. PERSONNEL WORKING ON CATALOGS IN x . '^f 

MEMBER STATES u ^ 



Alabama-' 



Technical Coordinator - Mr, James Kendrick 
Project Director - Mr. Chris Bond 



Florida 



Teci^ical Coordinator - Dr, Margaret Ferqueron 
Project Directors - Dr. Glen Morrill 

Mr. Roger Richardson 



Georgia 

• . * < * " • ■ ~ 

Technical Coordinator - Mra.. Bettye Hirst 
9 P^ject Directors - (Not ^j^ected at this time.) - 

Kentucky ' 

technical Coordinator -Mr. Robert Spillman ) 
Co-Directors - Mrs. .Joyce Trelkeld and -Mrs. Sarah Henry 
Mrs. Joy Hill and Mrs. Julie Cave ^ . 
Mr. Bruce Carpenter^ and Mr. Jcunes Maddox 
Mrs. Martha Keeton and Mr. Lee Cantrell 
Mr. John Thomas and Mr. Etigene Smotherman 
Mr. Merle Insko and Mr. Gary Scott 

Mississippi ' 

Technical Coordinator - Dr. Kent Brooks 
- Project Directors - (Not selected at this time—basic research ^ , 

and development being conducted by technical 
coordinator) 

■ ■ V 

Texas * * 

Technical Coordinator - Mrs. Julie Langenfeld - ^ 

Project Director - Mr. William H. Fltz 

Virginia 

Technical Coordinator - Dr. J. bale. Oliver 
Project Director - Dr. Richard K. HilT 
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- APPENDIX. "A 
Bylaws ' 
■of the 

VocationalrTechnical Education- Consortiiom of States 



31 



ERIC 



Appendix "A" 

- b^Slaws " > . * , ' 

The Vocational-Technical Education Cbnsortium of States 
For the Development of Catalogs of Performance Objectives and 
Criterion-Referenced Measures in Occupational Education 

• 'V . . , 

, y ^' ARTICLE I -NAMi-*^ ' , ^ 

The name of this organization shall be the Vocational-Technical 
* Education Consortium of States (V-TECS) . 

ARTICLE II -PURPOSES AND OBJECTIVES - ' * 

THe purpose arui objectives of V-TECS shall be to: 

a. Secure participation of Divisij^ns, Departments or Bureaus 

N 

of VocationaJ-Technical Education in State Educational j 
Agencies (or thieir appointed Representatives) in coopera- 
tive efforts for the purpose of producing and exchanging 
catalogs of performance objectives and criterion-referenced 
exercises in occupational education; 

b. Develop, implement, $nd evaluate standard performance 
criteria. to be utilized in the production of catalogs 
by each participating state to assure quality control 
and transportability of materials; 

c. Develop, implement, and evaluate a system for periodically 
updating and revising catalogs developed by' member states; 

dm Secu're additional technical or financial assistance from 
business. and industry, other interested State or Federal 
Agencies and educational foundations; and 
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e. Promote the concept of performance-based education as / 

3 means of improving curricula and providing for Increajsed 

• '-J ' ' 

accountability in occupational education, 

ARTICLE III-MEMBERSHIP — . . - 

Section 1. ^Membership in V-XECS shall consist of active 

membership and associate membership, , 

Section 2. "Active Membership" - Any State Educational Agency 
(or its appointed Representative) desirous of 
participating in the organization (participation 
being defined as submission of a letter of intent 
to, or a contract or grant for the member's pro- 
portional share of administrative costs including 
a commitment to develop or refine agreed upon 
catalogs) is entitled to become an active member 
of the organization. 

Section 3, "Associate Membership" - Any State, Federal or 

Non-Profit Private Agency desirous of participating 
in the organization (participation being defined 
as (1) a contract or grant for the member's pro- 
portional share of administrative costs, or (2) 
"in-kind" services consisting o'f the assignment of . 
personnel, products and systems under development) 
is entitled to .become an associate member of the 



organization, pen4ing approval<;Ay a^'inajority . 
vote of the Board of Directors* - 

ARTICLE IV-BOARD OF DIRECTORS 

k 

Sect^^eflTl. Number of directors. The business, property and 
^ affairs of V-TECS shall be managed by a Board 

<^f Directors consisting of one person^rom each 
state designated an "active member''^ Each 
"associate member" of the organization will be 
encouraged to apj^oint one person to serve as a 
member (ex officio) of the Board of Directors. 
V Directors representing "active members" will 

have vh^ing privileges while Directors from 
"assocrate members" will not have voting privilege 



Section 2. Membership on Board of Directors. Each person 
serving on the Board of Directors from a state 
designated as an "active member" shall be the 
pers-on identified by the State Director of Voca,^ 
tional Education in the State Plan for Vocat/^nal 
Education . The State Director of Vocational Educa 
tion shall also identify a person ta serve as an 
alternate member of the Board of Directors. 
Section 3. Qualifications of Directors. Each person serving 
(on the Board of Directors should have experience 
Ln curriculum development, evaluation methodolgg^ 
or related research in Occupational Education. 

\ ^ ' • . 
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Power to mlSke Bylaws. The Board of Directors shall 
have pcywei; to make ,^and alter any Bylaw or Bylaws, 
provided, that the Board shall not make or alter 
any Bylaw or^Bylavfs, fi:9ing the qualifications, ^ 
classification or term of office of any member or 
members of the then existing Board. 

ARTICLE V-ADMINISTERING AGEMCY , , 

Administering agency. An administering agency shall 
be retained by the Board of Directors of V-TECS 
provide technical assistance and coordination of 
activities for the member states. The agency selected 
shall have regional or national visibility and the 
"capability of developing broad-based contacts and 
alliances necessary to the attainment of the organi- 
zation's objectives. 

Financial support of the administering agency. Each 
state participating as an active member of the organi- 
zation shall assume a proportional share of the 
operational expenses of the administering agency. 
These expenses, which will be renegotiated annually, 
shall be payable between July land September 30 of 
the appropriate fiscal year. 



Section 3» Employment of staff. The Administering Agency with 
approval of the Board of Directors will employ staff 
as required to fulfill the Consortium level respon* 
sibilities. Ah Executive Director shall be employed 
to supervise thi^ staff and to work directly with 
the Board of Directors in operating the Consortium, 

Section 4. Fiscal accounting by administering agency. An annual 
accounting of all monetary receipts and disbursements 
shall be made by the administering agency. This^ audit 
shall be made by a certified public accounting firm 
selected by the administering agency and, upon receipt, 
shall be submitted to the Board of Directors for 
review and reaction. 

ARTICLE VI-OFFICERS 

Section 1. Chairman. The Chairman shall be selected by and from 
the voting membership of the^ Board of Directors. He 
shall preside over all meetings of the Board and shall 
see that' all recommendations and resolutions of the 
Board are carried into effect. In addition, he shall 
be an ex officio member of all standing committees. 

Section 2. Vice Chairman. A Vice Chairman shall be chosen from 

the voting membership of the Board. The Vice Chairman 
shall perform the duties and exercise the powers of 
the Chairman during the absence or disability of the 
Chairman. 
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ARTICLE VI I -MEETINGS OF THE BOARD OF DIRECTORS 

Section !• Frequency of meetings* Meetings of the Board of 
Directors: of V-TECS will be held quarterly. More 
frequent meetings may be called by the Board 
Chairman or by a majority of the voting members . 
of the Board* 

Section 2. Notification of meetings. All members of the- 
Board of Directors shall be notified in writing 
at least twenty days prior to the/meeting. , It 
shall be the responsibility of the Execut^ive 
Director of the Administering Agency to inform 
the Directors of the scheduled meeting. 

Section 3. Attendance at meetings. All members of the Board 
of Directors shall be expected to attend regular 
and special meetings^ In the event a member of the 
Board is unable to attend a meeting, a designated 
alternate from the member state will be permitted ^ ^ 
to attend and participate in all business * The 
names of designated alternates will be submitted 
to the Chairman of the Board and the Executive 
Director of the Administering Agency at the first 
regularly scheduled meeting of the Board. Any 
\ change in the person identified as designated 
alternate shall be reported in writing to the 
Chairman of the Board of Directors and the Executive 
Director of the Administering Agency. ^ 
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Section 4. Number of votes. to which each Director is entitled. 

At all meetings of the Board of Directors, each 

vp^ing Director shall have one vote. 
Section 5. Quorum at Director's meeting. A majority of voting 

Board of Directors or designated alternates shall 

be necessary to constitute a quorum for transaction 

of business . » 

Section 6. Majority vote. The act of the majority of Directors 
present, at a meeting at which a quorum is present 
shall be the act of the Board of Directors, * ^ 

Section 7^ Meeting place. The normal meeting place shall be 
. Atlanta, Georgia. 



ARTICLE VIII-STANDING COMMITTEES ; ^ 

' ■ * ' ^ ■ „ ^ ■■ 

The Chairman of the Board of Directors shall appoint sucJf^f^tandiAg ' 

committees and ad hoc committees as he and the Board of Directors 
deem necessary. 



ARTICLE IX-FISCAL YEAR 



The fiscal year of the organization shail be from July 1 to jthe 

■* . » 

following June 30, unless otherwise provided by the Board of 
Directors. 



ARTICLE X-AMENDMENTS TO BYLAWS 



Amendment without prior notice. The^e Bylaws may be amended 
^'^^J^hoiit prior notice by a^vote of two-thirds of the rareiffbers Of 
^the^ard of Directors at any regular meeting at* whith the,i^ - 



is a quorum present, 
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SOUTHERN ASSOCIATION OF COLLEGES AND SCHOOLS 
Commission on Occupational Education Institutions 
Vocatlonal--Technlcal Edupation Consort:tum of States 
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GLOSSARY OF TERMS 

* 

1. Catalog - A collection of performance objectives and companion 
criterion-referenced test items organized by domain area and further / 
broken down' by job titles within th^ .domain. ^ / 

2. Criterion-Referenced Test Exercise - A criterion-referenced test / 
exercise is an exercise based upon a performance objective and is / 
designed to allow the determination of whether or not the learner has 
accomplished the objective. It possesses each of the characteristics 
specified below: * [ 

a. Congruence - The task specified in the item corresponds 

directly, to the performance specified in the 
objectiviB, including the situation, action, 
* object, and limits. 

\ 

b. Comprehensihility - The item-specified task is so stated or 

' portrayed that the learner clearly under- 

stands what is expected of him. 

c. Objectivity - The exercise (including component items, if any) 

Is stated in such a way that all competent 
observers (evaluators) can make a clear and 
^ . equivocal decision as to whether or not the . 

learner has demonstrated an acceptable per- 
formance 

d. Integrity - The- exercise is structured in such a^ way that 

an acceptable- response to the exercise consti- 
tutes sufficient evidence, in and of itself, that 
the learner has accomplished the corresponding 
objective. 

e. Equivalence - If two or more ^exercises correspond to a single 

objective, each exercise in the set would be a 
true alternate, in that a student who passes 
J ' (or fails) one exercise on a given occasion 

would be expected to pass" (or fail) any otheij 
exercise in the set. 

3. Domain - A group of job titles which are closely related according 
to Vocational Education and Occupations , U. S. Department of Health, 
Education., and Welfare and U. S. Department of Labor, U'. S. Governn^i^t 
Printing Office, 1969. ^ . ^ 

4. Domain of Interest - The total content covered by a subject or 
occupatiofi. remain chdrtsf as they become a part of a task analysis, 
provide the limits within which the performance objectives and 
criterion-referenced test exercises are developed. 
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5. Incumbent Worker^ - A person who participates in the survey of workers 
in' business and industry, who holcjs a specific job at that particular 
time. 

6. Instructional System - An integrated combination of resources (students, 
instructors, materials, equipment, and facilities), techniques, and 
procedures performing efficiently the functions required to achieve 
specified learning objectives. 

7. Instructional System Development - A deliberate and orderly process 
for planning and developing instructional programs which insure that 
personnel are taught the knowledges, skills , and attitudes essential 
for successful job performance. This process is also known as 
Instructional System Engineering and Systems Approach to Training. 

8. Job - Xhe composite of duties and tasks actually performed by an 
individual. 

9. Job Inventory - A listing of all tasks to be performed. A composite 
]^isting of job performance requirements and standards. 

10. Job Performance Requirement or Standard - The tasks required of the" 
human component of a system, including the associated standard of 
performance. ' , 

11. Occupational Analysis - The process of identifying duties and tasks 
^yhich comprise workers' ^^sponsibijUties, in^^ collectionjp 
collation, arid analysis of such data. 

S 

12. Performance Objective - A performance objective is a statement in 
precise, measurable terms of a particular behavior to be exhibited 
by the learner under specified conditions. It possesses each of the 
elements or characteristics specified below: 

a. Situation - The. situation confronting the learner is clearly 

specified, including the mode in which stimuli 
are to be presented. ' 

b. Action - The action required of the learner is unambigously . 

defined, including the mode in which responses are 
to be made. 

c. Object - The object on which the learner is to operate (i.e., 

the object of the action) is clearly stated. 



d. Limits - The particular limits associated with the activity 

* expected of the learner are specified. (Limits may 

be placed on situation, action and/or object.) 

e. Measurability - The specified action is an observable rather 

n than an inferred response. 

f . Communicability - The objective is so stated that one, and | 

only one, interpretation of the objective y 
^ , is reasonably possible. 

ERIC ' A2 
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Criterion - The degree of proficiency required"' as evidence of 
accomplishment by a student of the objective 'is 
indicated. (The criterion mdy be indicated implicitly 
or explicitly, it implicit, 100 percent accurf^y is 
effectively designated. If explicity, it may be appended 
parenthetically to the statement of the objective.) 

•L3. Duty - A distinct grouping of tasks which are related to each other 
by the nature of the work to be performed. 

14. Task - A unit of work activity or operation that constitutes a logical 
and necessary step in the performance of a duty. ' , 

15. Task Analysis - The process of analyzing job inventory data so as to. 
determine training requirements. 
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(PHASE I MODEL—DEVELOPMENT PURPOSES ONLY) 



• , ' PHASE I MODEL FOR USE 

BY THE VOCATIONAL-TECHNICAL EDUCATION 
CONSORTIUM OF STATES TO MANAGE THE DEVELOPMENT, 
PRODUCTION, DISSEMINATION, AND IMPLEMENTATION OF CATALOGS 
OF PERFORMANCE OBJECTIVES AND CRITERiQN-REFERENCED MEASURES 
IN OCCUPATIONAL EDUCATION 



/ ^ ' INTRODUCTION 

The following model is the result of a study of seven otfier models: 
those used by the Air Force Training Command, the State of Florida', the 
State of Michigan, the State of Alabama, Project -CAREER within the State 
of Massachusetts, the Educational Testing Service, and the State of Utah. 
Components of the model were selected by the application of criteria taken 
from' the Agreement Form of the Vocational -Technical Education Consortium 
of States (V-TECS), the minutes of the 'ad -hoc Steering Committee which 
formed the Consortium, and the minutes of the Board of Directors, V-TECS. 
Some model components were the result -of additional research conducted 
through an exhaustive study of the literature, a computer-assisted search 
of the ERIC files, a computer search of journal articles, and a manual 
search of the Dissertation International Index. 

THE PHASE I MODEL ; 



Activity Number I 

Determination of Priorities and Assignment of Catalogs - 

This activity is the first step for developing catalogs of performance 
objectives arid criterion-referenced measures.' The activity has tour basic 
sub-activities which form the rationale and consensus for catalog priority 
idgj^tif ication and assignment to the member states of V-TECS. 

Sub-Activity I-l — State Priority Determination 

The member states study data available -to them concerning manpower needs, 
employment opportunities, and student interest surveys to establish a priority 
list within the state for catalogs of performance objectives and criterion- 
referenced measures. A state may consider regional and, national data to 
determine its priorities or ''any other information which it deems necessary 
or appropriate. 

Sub-Activity 1-2— Consortium Priority Determination 

The Board of Directors of V-TECS will discuss, in turn, the priorities 
established by each member state. The purpose of this structured discussion 
is to develop a priority listing from which the member states may select and 
be assigned a certain number -of '^catalogs to develop. This sub-activity is to 
assure that duplication does not occur and that a state has the opportunity to 
negotiate for^pecific catalogs in which it has a particular interest or for which 
considerable work has already been accomplished. 
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Sub-Activity 1-3 — Resolution of Conflict and Exchange of Previous Work Rdfated 
to Catalogs to be Developed 

Should states no^.be able to resolve priority preference conflicts, a 
drawing of assignments will be conducted by the Board of Directors.' In case 
a state does not get Its desired priority atea for reasons Identified by t-.he 
Board of Directors, a copy of such accomplished work would be -provided to the 
state assigned the catalog area In dispute. This material will be included 
as an essential part of the state-of-the-art study to eliminate duplication <^ 
of effort. 

^ Sub-A^lvlty 1-4 — Assignment and/or Selection of Catalogs - 

The Board of Directors makes the decision concerning the final selection 
and/or assignment of catalogs after state and Consortium priorities have been 
dete'nnlned. Two primary considerations are given member states on the selection 
of a catalog: 

' ' «». 

(1) the state has a particular interest in a domain area 

(2) the state has accomplished or has in progiress considerable 
' work in a domain area which would benefit the Consortium 

0 Catalogs assigned by the Board of Directors of the Consortium are subject 
to acceptance by the state Involved in the assignment. 

Activity Number II 
The Memorandum of ■■ Agreement 

A Memorandum of Agreement is entered between the state selecting or being 
assigned a catalog to develop and the Consortium. The parties of the Memorandum 
of Agreement are the Chairman of the Board of Directors of V-TECS, the Executive 
Director of V-TECS ajad the person designated by the State ''s Plan for Vocational 
Education as the State Director of Vocational Education. This activity has three 
sub-activities which 'must be completed prior to the developmental work on a 
catalog. Sub-activity II-l identifies the minimum content, and sub-activity 
II-2 outlines the process of approval of the Memorandum of Agreement, and II-3 
is in regard to "the Selection of a Project Director. 

Sub-Activity II-l — ^Minimum Contents of the Memorandum of Agreement 

The Memorandum of Agreement will be developed by the Consortium staff, and 
after a period of- time, will be standardized. The Memorandum of Agreement will 
contain' the following, minimum items: . 



(1) date and name of catalog domain area including job titles to be 
surveyed 

(2) designated signature blanks 

(3) specific delivery dates for; 

(a) domain study and task lists 

(b) task analysis and survey results 

(c) ^catalog of performance objectives and 
criterion-referenced measures 

(d) field test period 

(e) . final catalog and field test results 
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(A) responsibilities of a full-time technical coordinator 

in the state and to the Consortium 
(5) Consortium staff involvement in the development of catalogs 

and the development of in-service training and dissemination 

plans. ' . 

*• . , " 

Sub-Activity II-2 — Processing the Memorandum of Agreement ■ 

The Memorandum of Agreement will take the following course for 

development and approval: ^ 

I . ' ■ ■ " ■ . 

(1) ' format developed and prepared by the Consortium staff 

(2) Memorandum of Agreement reviewed and Signed by the Chairman 
■ ' of the Board of Directors and the Executive Director of 

V-TECS 

(3) Memorandum of Agreement mailed to the states for review 
and signature by the State Director of Vocational-Technical 
Education 

(4) designated copies distributed and prbject starts 

(5) periodic PERT reports are mailed to states on request \- 

Sub-Activity II-3— Selection of a Project Director 

Each state developing a catalog of performance objectives and criterion- 
referenced measures will select a person to serve as project director. The 
project director selects and manages writing teams which are composed of 
selected instructors in the domain being developed. These writing teams are 
trained by the project director" and stat^ technical coordinator to analyze 
"the data resulting from the occupational analysis system, the finc^gs of the 
state-of-the-art study, and other pertinent information. The project director 
Is responsible for submitting to the state technical coordinator results of 
studies and analyses of data, catalogs of performance objectives and criterion- 
referenced measures, and other products required by the Memorandum of Agreement. 
The project director will meet the same qualifications established by the Board 
of Directors of V-TECS for the technical coordinator in each state. 

Activity Number III 
Technical Preparation of V-TECS Staff and State Coordinators 

The' technical preparation and training of the Consortium staff arid thp 
technical coordinators in the states are paramount to maintaining quality 
control. A program of technical development will begin with an or-Jentation 
to the model to insure that technical skills and knowledge are sufficiently 
developed to provide maximum quality control. This activity is divided into 
six sub-activities which fbrm the basis for staff preparation and training 
and are as follows: 

.Sub-Activity III-l— System Orientation 

A program designed to insure the performance of Consortiuia-s-t^ atid 
technical coordinators will be administered. The orientation is in performance 
terms with^ each person sa,tisfactorily completing the required tasks at a 
criterion-based performance level. Orientation to the system will not be 
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considered complete until the performance standards are met by the Consortium 
staff and the technical coordinators.*^^ 

Sub -Activity III-2 — Determining Decision Cifiteria 

The Board of Directors and the staff of V-TECS will develop the decision 
criteria to be used in the determination of tasks to Jbe convrtted to per- 
formance objectives for cataloging. The decisions will be based upon cut-off 
indices of time-spent, difficulty, criticality, and task perishability. Other 
bases for decision criteria may be developed by the Board of Directors based 
upon research of the data resulting from the surveys of the :^cumbent workers 
and their immediate supervisors, 

Sub-Activity III-3— Interpretation of Task Analysis Data 

An intensive training plan will guide the preparation of Consortium 
staff and personnel within the states to effectively utilize the data from the 
task analysis system. This training will assist personnel in the determination 
of index measures of tasks which a^e sufficiently high to use in a catalog. 
Optimum index rating scores will be' developed j when experience demonstrates 
that such a rating is feasible. Any tasks which fall below the desired index 
rating or combination of indice ratings will be excluded from conversion to 
performance objectives. Continuous training will be conducted for personnel 
as the task analysis system develops and the analysis of the research indicates 
a need for further training. - * 

, Svib -Activity III-4 — Developing Skills in Writing Performance Objectives 

Workshops, seminars, and conferences will focus on the development of 
skills needed to write performance bbjectives. Consortium staff and technical 
coordinators will be expected to demonstrate their ability to take a given • 
set of task statements and data, then develop written performance objectives 
and criterion-referenced test items. 

Sub-Activity III-5 — Preparing Criterion-Referenced Te|t Items 

Following the training o^ the staff and technical coordinators in the 
skills of writing performance objectives from t^sk analysis data and task 
statements, intensive^f forts will be introduced to develop companion criterion- 
referenced test item^) for each performance objective. A. task statement will 
yield one or more performance objectiyes, and a performance objective will yield 
one or more criterion-referenced test items. Criterion-referenced test writing 
experts will serve as consultants for training Consortium staff and state tech- 
nical coordinators. Personnel will either be sent to the source of technical 
expertise or the ii^xperts will be assembled, in conference, seminar, or workshop 
settings^. - - 

Sub-Activity IiI-6 — Monitoring and Quality: Control* of Personnel , Education , 
and Training • ' 

The Consortium- staff, and state technical coordinators will develop indivi- 
dual plans of technical preparation for themselves under guidelines developed 
by the Board of Directors of V-TECS. These plans would serve as a guide to 
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Insure minimum competence levels of personnel of the Consortium staff and 
within the states. The Executive Director of the Consortium has the ultimate 
responsibility for monitoring individual training programs of the Consortiums- 
staff and^state technical coordinators in J;he states. The Board of Directofs 
will receive at least a biannifel status report of the technical preparation 
acCTvities designed for individual Consortium staff and technical coordina- 
tors within the states. Reports o^ this nature may be requested any time the 
Board of Directors desires to know the status of the total plan or individual 
progress of personnel. 

Activity Number IV 
Domain Study for Catalog Development 4, 

The domain study consists of thorough and organized research of what 
has been developed in performance objectives and criterion-referenced measures 
which might be appropriate and helpful during the development of a catalog. 
A domain consists of a broad instructional area (such as automotive mechanics) 
and should include appropriate job 'titles (e.g. automotive tune-up mechanic," 
service station mechanic, service station attendant, front end and brake mechanic, 
general automotive mechanic). Activity IV consists of at least four sub-activities; 



Sub-Activity IV-1 — State-of-the-Art Study 



/ 



This activity increases the probability that Consortium projects will 
find material which has already been partially or fully developed by others 
in a domain area. The state-of-the-art study will include the following 
research activities as a part of the states' development of catalogs: 



(1) ' a search of the ERIC system for germane information 

(2) a search of the journal index of ERIC for germane articles 

(3) inquiries to the U. S. Office of Education, National Center 
for Curriculum Development in Occupational Education 

(4) selected inquiries to state departments of education for, 
germane material 

(5) inquiries to industry and private training institutions 

(6) review of the^ Dissertation Abstract International Index 

(7) inquiry to local education agencies identified as working 
on germane projects ♦ 

Sub-Activity IV- 2 — Task List Development 

A comprehensive list of tasks performed by the incumbent worker will 
be developed as a part of the domain study. The task list will be based upon 
research completed in the state-of-the-art study (sub-activity IV-1) and, 
in addition, will include the. following: 

(1) a Job structure arranged from the lowest job titles t^ the - 
highest job title within a domain 

(2) a coding system developed by the Consortium and identified in 
the Dictionary of Occupational Titles will be applied to the job' 
structure 
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(3) development of a task list using the following sources for 
obtaining task statements: / 
^ (a) review and observation of technical procedures used by 
workers 

(b) identification of existing task lists or statements from 
technical manuals and germane literature 

(c) interviews with incumbent workers and their immediate 
supervisors 

(d) use of craft committees and selected committees of 
instructors identify incumbent worker tasks 

.(e) provision of space far -a- survey of incumbent workers 
to add task statements not included on the list 

Sub-Activity IV- 3 — Development ^bf Background Information 

This part of the domain sftidy will be used in conjunction with the 
task list to provide data whiclx may be cross-tabulated and studied with 
the companion task lists. The?^background information section will include 
as a minimum: 




(1) information about th« ©icumbent worker and/or supervisor * 

(a) name and addres^ c^f incumbent worker 

(b) date survey completed by incumbent worker 

(c) ' job title or classification 

(d) years and months of experience in career field 

(e) years and months of experience in.present job title 
or classification 

(f) previous vocational- technical training 

(g) private or public school attendance 

highest "gtrade' level completed or GED equivalent — — 

(2) information about ^^job satisfaction 

(3) infonnation about l.utllization of talents and prior training 

(4) list of equipment? fiuid tools used itv the jobs of the domain 

(5) type of work environment of the -incumbent worker 

(6) . size of business, ^br— indAi&try 

h 

Sub-Activity IV-4 — Reports ^bf the Domain Study 

The following reports ^11 be required of the domain study activity: 
(1) state-of-the-art study: This report includes the' methods used to meet 
the requirements of sub-activity IV-1, (1), (2), and (3) of the model; (2) 
background information and task list: This r-^port includes a comprehensive 
section on background data to be completed by all incumbent workers who are 
surveyed. Following this section wil^. be a comprehensive task listing which 
each incumbent worker will be asked to verify in his job classification. He 
will also be given the opportunity to add any task he is performing which is 
not included. The background information and task lists will be printed, in 
booklet form, in a standard format set by the Consortium staff and approved 
by the Board of Directors. 
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Activity Number V 
Development and Implementation, of the 
Domain S&mpllng Technique for the Task Statement Survey - 

The purpose of this activity Is to obtain a sample of Incumbent workers 
by a domain area and collect certain Information from those sampled to be 
used later In a task analysis. Survey booklets of . task statements ajee^ developed 
and printed using a standard format for the background and .task statement Informa 
tlon. The sampling design would be developed by an Independent agency. This 
activity Is divided Into three sub-actlvltles dealing with the sample design, 
sai<^le administration, and processing of the survey results. Alternative pro- 
cedures are Included as a part of sub-actlvlty V-1 and sulj-actlvlty V-2. 

Sub-Ac t^lty V-1 — Design of the Sample 

(a) Optimum sample design—The optimum sample design consists of 
administration of the task statement survey to stratified random sampling 
of Incumbent workers holding a job classified within the domain. The base 
data to be used in determining the sample size will be the occupational 
Information (codeTd from the Dictionary of Occupational Titles) collected 
during the 1970 Census of the United States. The body of the Information 
collected will be statistically analyzed with Inferences made . to Jthe. popula--^,^^ 
tlon. (All workers In the United States In a given job classification within 

a specific domain.) 

(b) Alternative sample design .#1 — The alternative sample design #1 
collects information using the same base data as in V-1 (a) but limits the 
sample to the member states of the Consortium and makes no Inferences beyond 
those states surveyed. 

(c) Alternative sample design #2 — The altematl^VB*^ample design #2 
collects information using the same base data as in V-1 (a) but limits the 
sample to the state which is developing a task survey in a particular domain. 
A purposive sample could be used by any state desiring to validate task lists 
within a state not included in the survey, 

Sub-Activity V-2 — Administration of the Occupational Analysis Survey > 

(a) Optimum administration — The optimum administration of the survey 
would be conducted through a central staff in the Consortium office. This 
would permit control of the follow-up letters, follow-up telephone calls, 
and general sequence timing of the surveys. Limitations exist in the appli- 
cation of the optimum administration which are proportionate to the activities 
selected in sub-activity V-1. 

(b) Alternative administration—An alternative method of administration 

^ would be to have each state which develops the task statement lists also conduct 
the survey of incumbent workers based upon the selection of the sample design 
in sub-activity V-1. This method is based upon a thorough development of a 
sampling administration criteria which will be used in the survey efforts. 
A^ sub-sample will be selected and individually Interviewed on the work site to 
compare with the results of the mail-out survey. 



50 



A6 



Sub-Actlvlty V-3~Processlng the Survey Results 

The results of the survey will be. keypunched or optically scanned and 
computerized. Various analyses will be made of the data to make decisions 
about tasks performed by incumbent workers. These survey results will provide 
the basis for writing performance objectives and criterion-referenced test 
items, Indices^of time-spent , difficulty, criticality, and perishability 
will provide the basis for strategic decision making. The analysis will be 
accomplished by using computer programs designed by the U; ,S. Air Fprce for 
this purpose. . • 



Activity Number VI 
Occupational Analysis System 

The backbone of the Phas.e I Model is the system used to develop scientific - 
task,,analysis information based upon a direct survey of incumbent workers. This 
eff^ort should affect the quality, realism, and scope of the catalogs of per- ^ - 
formance objectives. The basic source document for the task analysis system 
is the task statement survey and background information collected from the in- 
cumbent worker. Activity Number VI has five basic sub-activities yhich make 
up the system of task analysis. These Sub-activities have to do with computed 
indices of task time-spent , task difficulty, task crittcality, task perishability, 
and computer analysis and reporting. . 

- Sub - Activity VI-l~Task Time-Spent Index' 

The incumbent workers complete the background information and check the ^ 
!' tasks they actually perform in the task statement' booklet . After ^checking the 
r task statement, the Incumbent worker rates the relative amount- of time spent 
on the task along a seven-point scale. The response on the .scale is convert^^d, . 
to a time-spent index based on percentages over the total group of task state- 
ments checked'. The resulting percentage figure is cumulative to 100 percent' 
on all tasks checked. This conversion of information and calculations is 
accomplished by use of a computer. 

^ub-Activity VI-2— Task Criticality Index 

The inciwnbent worker rates a task in terms of its critical performance. 
The primary interest of this part of the task analysis is to ascertain by use 
of a seven-point scale the relative critical values of each task. When obtained, 
the index of criticality can be applied to the development of performance ob- 
jectives.^ A thorop^h review of this critical index will identify the tasks 
which fi^^ most critical in descending order to those which are considered least 
y V critical. On the basis of these data, determination can be made regarding the 
consequences of a poor performance of the critical tasks. 

Sub-Activity VI-3— Task Difficulty Index 

The same process is used to calculate an index of task difficulty which 
is used in the determination of the time-spent index. A seven-point scale 
is again employed to determine the incumbent worker's perception of task 
difficulty. One additional step is included to determine the task difficulty 
index. The task statement survey is also administered , to the immediate super- 
visor of the incumbent worker. The responses are then correlated, and the 
resulting figure becomes the difficulty index. 
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Sub-Ac tlvlty Vl-»4"Task Perishability Index 

The same samplli^g tech^fue.ar^d ^ncumb^tj' wo?:k^s are used to obtain 
a perishability Index^ Tl^ Jftdex 4.5 a measurt,^ 4>n a seven-point scale, of the 
relative perishability ^J^itask statement currently being performed by the' 
Incumbent workers part;^^'atii|g In the survey^] This Index will relate to the 
need for .retralnlngjm^:'^^^ courses should the worker tiot perform, 

contlnucJus bas Is ,^^^q.^€^'* tasks which are ra^ed ' to' have high Indices of.^ 
ability. One Ix^j^d^l^sfron of this type vof Index 'is to provide guldanc^ 
development 'of i^j^f^-^pace^d Instructional packages which have as a b^sls 
tasks which ha^e the hljgher perishability :yidlces. Retraining and de^leTop- 
ment of materials could be minimized by including objectives for tasks which 
have high indices of perishability. • ' ij 

. ■ " / 

Sub-Activity VI-5 — Proc^sing . of Data and Development of R eports 

■ ■• \\ '/ * .... - . 

' TJie information. colOjtcted from sub-^activity VI-1, VI-2, VI-r3, and ' VI -4 
will bVcomputerized fojOstatistical analysis. Information will be trans-- ' 
•lated frbm^iuialitatlver data to quantitative data. ^ The quantitative data will 
t)t'o4uce the index valu^es of time spent, crlticallty, difficulty, and perish- 
ability. Many btlTer statistical analyses can be applied to the data for the 
purpose of rank ordering, multiple regression analyses, cross tabulation of tasfes 
with elements alid sub-elements of the background information, etc. The result- 
ing printouts will be furnished to the state developing the catalog of perfonriance 
objectives and crlterlon^referenced measures as a basis for their developmental 
c,tivlties and de^slon making. 



_ , Ac t ivity -Number VI r — — ^ ^ 

Development of Catalogs of Performance Objectives 
and Criterion-Referenced Measures 

The activities prior to Activity VII have emphasized primarily the , ^ 
training and preparation of personnel, the collection and analysis of information, 
and other preliminary steps necessary to write and catalog 'performance objectives 
and crlterlon-r^erenced measures. This activity is the application stage of 
the model. Information from Incumbent workers is combined with the knowledge 
of selected Instructors, currlculunr specialists, criterion-referenced test 
designers, and educatior^al reseawmers to transpose the resulting data IntQ 
meaningful test items. Activity VII contains four sub-activities designed 
to accomplish this task which are:- as follows: 

Sub-Activity VII-1 — Selectlon%i^reparatlon of the Writing Teams 

(1) Selection of Wrltlng'T^ns — The project director andy-technical 
coordinator screen possible writing team candidates and select those instruc- 
tional personnel which they determine have the potential and Interest to 
write performance objectives and criLterion-ref erenced measures.' The writing 
team will consist of 'a minimum of one Instructor, one technical writer, one 
person having demonstrated ability and experience ,ln developing criterion- ^ 
referenced measures and one person having either local or state supervisory 
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responsibility over the domain being developed. Each writing team should have 
a preferred alternate member who has respbnsibility in curriculum development 
at the local or state level Exceptions to the writing team composition will 
be made upon request by the state developing the catalog. The request will be 
transmitted to the Board o'f Directors with appropriate justification for the ' 
exceptions. Decisions will rest with the Board of Directors. 

(2) Preparation^ of Writing Teams — The-state technical coordinator will 
chave the primary responsibility of assisting the project director in the 
traiming of the writing team members. The total design of the model will be 
explained — the results of the sta^-of-the-ar^ study, the task analysis system,^ 
and the conversion process from task statements to per£ormance objectives. 
Companion criterion-referenced measures will be prepared 'for each ^performance 
objective incorporating performance standards which are used on the job when 
these standards ar^ available. Components of the training program developed 
for the Consortium and state techq^cal coordinators will be lised as the basis 
for training and preparing the writing teams for their tasks. 

Sub-Activity VII-2 — Writing y Perf ormance Objectives - 

All performance objectives developed by the writing teams will meet the 
definitions and quality criteria set forth in the Memorandum of Agreement. 
The components of the performance objective will contain the following 
requirements: situation confronting the learner, action required of the 
learner, object on which learner Is to operate, limits of performance, ' 
measnrability of the action, communicability of the objective, and degree 
of proficiency required of the learner. 

Sub-Activity VII-3 — Preparing Criterion-Referenced Measures 
Each perforaaric^^ 

referenced test items to be used by instructional personnel. The test items 
will be studied to insure thatla definite relationship exists between the 
criterion-referenced Item and. |he standard of performance stated in the. 
p.^rformance objective. The definition and components of an acceptable criterion 
referenced measure are spelled out in the Memorandum of Agreement and will in- 
clude: congruence with the performance objective, comprehensibility (expressed 
at a proper reading level for .the level of tfhp training program), objectivity 
of the test item, integrity expressed in terms of sufficient evidence that the 
learner can perform the corresponding objective, and equivalence within the test 
items./ The" criterion-referenced test items will be developed by the writing 
teams which develop the performance objectives under the technical direction of 
the person on the team with test item experience, the director of the project, 
the technical coordinator in the state, and the technical specialist on the 
Consortium staff. Partici|lar etnphasis would be placed upon explicit information 
concerning criterion of performance on-the-job and conditions under which per- 
formance occurs. Standards would be based upon those usea by business and 
industrial workers. ^ • ^ 
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Sub-Actlvltv VTT-4 — Developing the Catalog of Performance Objectives and ^ 
Criterion-Referenced Measures . 

The performance objectives and criterion-referenced measures will be 
coded by job classification within the domain being developed. This coding 
system will be developed by the Consortium and applied to all products of the 
Consortium. Catalog format and content are outlined in detail* and are available 
through the technical coordinator in each state. All catalogs will be furnished 
In final draft form (camera ready) for mass production. 

Activity Number VIII 
Field Testing and Commonality Study: 

This activity is designed to determine the instructional acceptability of 
the performance objectives and criterion-referenced measures. The degree of 
' validity will be determined by analysis of teacher and Instructor responses 
to questions during the field test? portion of each project. Fie^Jd test sites 
and conditions will be selected by the application of a criterion developed by . 
. the Board of Directors, Consortium staff , and technical coordinators. Activity 
VIII consists of four sub-activities as follows: 

^ Sub-Actlvltv VIII-1— Field Testing Design 

The field test is designed ' to control the variables under which the 
catalogs will be tried by teachers and instructors. Controls are placed .upon 
the selection of the site of field testing, supervisory and administrative 
support and interest, instructor- qr teacher Interest and ability, type of 
facilities and equipment, and level of students (junior high schools, secondary, 
post-secondary, etc.) The primary emphasis is placed upon determining compre- , 

- henslbllltyv utility , - and -appropriateness-- f or ^ ins tructlon^ as perceived by .the 

teachers and instructors. Constraints which prevent the use of a given per- 
formance objective and companion criterion-referenced measures are identified 
by the Instructional personnel. 

Sub-Activity VIII-2— Commonality Review 

During the field test, several reviews of performance objectives are^made 
by teachers and Instructors for the purpose of identifying the common performance 
objectives across a wide, group of occupational education programs. This com- 
monallty study identifies those common performance objectives within the catalog 
which are applicable in several ^occupational domains. The common core identified 
is analyzed for implications for Curriculum design in general shop, pre-vocatlonal, 
and comprehensive career education programs. 

Sub -Actlvltv VIII-3— Evaluation of Criterion- Referenced Test Items 

A jury including an Incumbent worker, a criterion-referenced test item 
i j'yriter, an instructoAln the catalog domain area, and a supervisor of the 
-"CAncumbent workers represented would be used to make a final review of the 

criterion-referenced test items. The primary purpose of this activity will 
be to reach congruence- on the behavior being tested and to permit ij^rence 
of competence should the learner meet the specified performance. 
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o.K-A.^^.H^v'\mT-4-- Deter"Ininat^ny o& Performance Obiectives a£id ^riterion- 
~efI7i^ Measures Which are Applicable to Handicapped Persons 

The field test version of the catalog of performance objectives and 
criterion-referenced test items will be reviewed by a committee of persons 
to determine fheir Applicability to the training of handicapped Persons. 
The appropriat-e performance objectives and criterion-referenced test item 
will be coded- for each of the specific types of handicapped- persons, i.e., 
partially sighted, speech defects, hard of bearing, crippled, and mentally 
retarded, etc. A special review committee for the handicapped will consist 
of. a > curriculum developer, an instructor from the catalog domain area and a 
representative of each of the handicapped groifps who has the ability to 
determine the training limitations of handicapped persons in each group. 
Thf ^rk of the committee will be coded and computerized for retrieval for 
use in planning realistic training programs £or the handicapped. 



-Activity Number IX 
Computerize Performance Obiectives and 
Criterion-Referenced Measures 

. ■ ■* 
The primary purpose of this activity's to provide immediate response 
to the states' requests for catalogs. The computer banking of performance 
objectives and criterion-ref erehced measures- eliminates the ^i^^^"^""^""?^"^ , ^ , 
and costly step of technical editing each" time a catalog is ^^^^^'^^^"'^ "P^^^^J ' 
Since only those objectives actually changed will ?e accessed from the computer, 
the majority remain unchanged and may be retrieved and printed in the same 
manner each time. Research capabilities, as well as many management possi- 
bUities , exist when the computer is used to do . time-consuming calculations , 
compiling, and cataloging of performance: objectives and criterion-referenced 
measures. This activity contains four^b-activities as follows. 

^-AMMvlj^ Tj(-l- -DevelopinR Computer Bank M Performance Objectives and 
Criterion-Referenced Measures . — ^ ^ ■ 

.Atter fi£ld testing, the catalogs of performance objectives and criterion- 
1-efefrenced measures are processed And placed in" a computer bank for rapid re- 
^riS" The coding system adopted by the Consortium is the key to the retrieval 
sys^m for the- computerized information. The information is arranged so that it 
Jay he reprieved by domain area or any c<^ed job within a domain; A member, of 
21 Consortium may request the total catalog or any of its sub-parts for use in 
curriculum design and curriculum building. Information is "-^^^^/^^^/"^"^ 
the perceptions of the teachers and Instructors during the field test and _ . 
coLonality review. These perception/ concern the comprehensiveness utility, 
and appropriateness of the performance objectives and criterion-referenced 
measures for instruction. In addition, the perceptions concerning the 
c™ality of performance objectives, across several programs in occupational 
education, are collected for analysis- 
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Sub-Activity IX- 2 — Reseaifch Aspects- of the Computerized Performance Objectives 
and Criterion-Referenced Measures ' ^ 

(1) Field Test Data— Information collected during the field test activity 
is analyzed by the computer. The purpose of this analysis is to identify those 
performance objectives and criterion-referenced measures which appear to be 
defective. When the defective objectives and measures have been identified, 
they are forwarded to the state which developed the catalog with instructions 
for removing the possible defects.., ^ ^ ^ 

(2) Coiranonality Review — The results of the commonality review by teachers 
and instructors form the basis for the identification of core performance 
objectives. This common core provides a basis for planning curriculum for 
pre-vocational, general shop, related sut^jects, and career education programs. 
These' common performance objectives also provide a framework for prerequisite 
skills, knowledge, and abilities needed by students to further their prepara- 
tion for employment at ^a higher level. 

(3) Cross-Analysis Research — Computer programs will be utilized which 
cross-tabulate and cross-analyze ^ data received from teachers and instructors 
With data collected from the task analysis based upon surveys of incumbent _ 
workers and their iiranediate supervisors. The research implications of these 
data. are unlimited when incorporated into the Revision and Updating Activities 
of the model. 

Sub-Activity IX-3 — Management of Perfoimanca Objectives aifd Criterion-Referenced 
Measures / ■ ^ 

^ The application"^ a code number to each performance objective, which 
relat^es it to a specific domain and, within the domain, to a specific job J.* 
claslsification,,; provides 4n addect degree of manageability. Thfe performance^ 
objectives will be retrieved from the computer bank by job classification, by 
total domain, by copmionality elements, or other tnixes required for planning 
various training programs. The computer cau be used to compile the catalog 
by printing out performance objectives in alljit desired structure or sub-structure 
within a domain. Training programs for a new or expanding industry may be designed 
and retrieved from the computer and can provide those performance objectives 
which correlate witli the job structure of the new .industry . The resulting 
performance objectives provide a realistic planning base for curriculum which 
must be tailor-made for the task-at hand. Many other curriculum management 
advantages can be developed upon this computer bank of performance objectives. 
The curriculum design implicatipns'^re limited only by financial resources and . 
human ingenuity. 

Sub-Activity lx-4— Development of Special Reports for gaining the Handicapped 
Learner " ' . 



The information collected from the work of the special coiranittee for the 
handicapped (sub-activity VIII-4) would be computerized and used as a research 
base for developing, planning, and organizing a training program and activities 
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for the handicapped learner. The performances specified in the^objectives 
and criterion-referenced measures could be modified to permit handicapped 
workers to demonstrate their ability in terms of particular job titles. 
Other valuable research could be accomplished by using the data concerning 
the abilities of the handicapped and comparing it with background information 
from the. incumbent workers and their immediate supervisors. 



Activity Number X 
In-Service Education and Dissemination . Plans 

Each state using the materials of the Consortium will develop a compre- 
hensive model for disseminating the catalogs of performance objectives and 
criterion-referenced measured.- In addition, a comprehensive in-secvice 
training program must be developed which is designed to prepare both in- 
structional personnel and supervisory personnel in the techniques of managing 
performance-based instruction. Performance-based instruction requires a ' 
thorough knowledge and new skills for teachers atid their managers if it is 
t.o achieve the desired results. This activity contains sub-activities which 
are directed toward the achievement of an acceptable degree of implementation of ^ 
performance-based instruction in the classrooms, laboratories, and shops of 
p^ticipating states. 

■ \ ' ^ . ■■ 

Sub-Activity X-1 — In-Service for Curriculum Developers ' ' 

Specific programs will be planned for , preparing curriculum developers 
troncerning the use of catalogs for organizing Ij^aming activities. These 
programs are to be planned jointly with. Consortium staff and include a 
comprehensive explanation "of the system used to develop catalogs, 'the skills 
required for retrieving appropriate performance objectives and criterion-referenced 
measures, and the management strategies necessary to implement a -performance- 
based curriculum effort in the classroom and laboratory. Strategies will also be 
included to provide direction in the organisation and preparation of learning 
activities. \ 

Sub-Activity X-2 — In-Service Education for Teachers and Supervisors 

A requirement of Consortium membership is the development, by each state, 
of an in-service education program for teachers and managers of teachers who 
will begin to use the catalogs of performance objectives and criterion-ref erenced_. 
measures. The 'in-service program should be designed to instruct personnel^on 
the intention of the catalog, how -to select performance objectives and criterion- 
referenced measures, and how to supplement their selection with curriculum materials 
and student learning activities. Those who supervise, direct, or administer programs 
and have direct contact with the teacher who will be using the material shoul<i be 
trained in the management aspects of performance-based instruction. The basic 
requirements of the in-service education plan are developed and/or modified by 
the Board of Directors of V-TECS. ; ^ 
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Sub-Activity X-B—Disseminat ion of ' Materials , 

A dissemination outline to be developed by the Board of Directors of 
V-TECS should serve as a guide for the states. The specific methods of 
dissemination are left entirely to the participating states. The Consortium 
staff will assist the states as needed and will encourage the dissemination 
plan to be integrated with the in-service education plan when at all possible. 
This integration should insure proper preparation of the. users and managers 
of the learning process and, at the same , time, provide a logical point of 
dissemination. 

Activity Number XI 
Revision ' and Updating of the Catalog^ 

' The rapid rate of change in a .technical society mandates a better way ^of 
keeping vocational-technical instructional materials up-to-date; but, more 
importantly, it mandates keeping them relevant to the needs of a modern job 
^structure. This activity is designed to maximize input from instructional 
personnel," craft advisory committees, and the incumbent worker so that catalogs 
may be revised on a scientific and as-needed basis. This activity contains 
four sub-activities which form a cycle for revising and updating the catalogs . 
The cycle will 'take approximately three. years to complete with a decision to 
revise and update or not t6 revise and update at the eighteen-month point in 
the cycle. . 

Sub-Activity XI-1-— Field Utilization Study 

Continuous field study is made regarding the catalogs of performance 
objectives and criterion-referenced measures. The purposes of the field 
study are to: (1) detect the .defective performance objectives and criterion- 
referenced measures, (2) identify Additional performance objectives which may 
heed to be added to the catalog when it is revised, ^and (3) obtain a wider 
participation in the developmental activities, particularly in the area of 
curriculum materials . 

The. field utilization study has two major components for achieving the 
purposes: ' ^ 

(1) Teacher and Curriculum Developer Inputs—During the first year of use, 
the teachers and curriculum developers will be asked. to react to questions 
concerning readability, comprehens ibil ity , specificity, and appropriateness of 
performance objective's and criterion-referenced measures. This information is 
a^^ed to the body of data already existing on the performance objective as a 
result of the commonality study and the field test results. 

(2) Ciraft Advisory Committee Inputs— Early in the second year, the craft 
advisory committees for the programs using the material review each perfonuance 
objective and respond to questions concerning (a) the utility of the performance 
objective, (b) the appropriateness for present job requirements, (c) the extent 
to which the performance objective is accomplished by entry level employees, 
relatively experienced employees, and experienced employees, and (d) the relative 
criticality of the performance objective. 
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Sub-Activity XI-2 — Analysis of Data from Field Utilization . Study ^ 

• The information collected from the fie^d utilization study is computerized, 
and reports are developed to determine the "results. Statistical analysis is 
applied to the data to accomplish the purposies qf the field utilization study. 
Data are compared with the results pf sub-activfty XI-3, survey of incumbent 
workers, for the purpose of deciding whether the catalog should be raised and 
updated or if it is still sufficiently valid for continued use, 

Sub-Activity XI-3 — Conducting New Task Analysis 




Th'e same pfocediire used in Activity VI', task analysis system, is used at 
t'he twenty-fourth month ^oint in the revision and updating cycle The same 
task statements are used with the exception that those added by incumbent workers 
on the tjj^itial survey^are included for this survey application. 

Addit^nal information requested of the incumbent worker is that he add 
any tasks he is now doing which do not appear on the list and. place an asterisk 
by those task statements which he has begun to perfojm for the first time 
during the last twelve months. > ^ h 

Sub-Activity XI-4 — Decision Criteria for Revising and Updating Catalogs 

The information collected on the new task analysis is computerized^ and ^' 
analyzed. The purpose of the analysis is to determine the extent of ifcw tasks 
identified by incumbent workers which have been accomplished the first) time during 
the-imme^iate past twelve months. A review of the results of the field utiliza- 
tion study (sub-activity XI-1) and the survey of incumbent workers forms the basis 
for the decision regarding the need for revision and updating of the catalogs or 
portions of the catalogs. If the data suggests a need for revision, the catalogs 
are |fut through the same process as for their initial development. 

Activity Number XII 
Third Party Evaluation of the Vocational-Technical 
Education Consortium of States 

Evaluation of the Consortium on a biennial basis is considered desirable 
by the Board of Directors of V-TECS. A third party evaluator will be selected 
on a low bid basis from a group of competent an^ qualified evaluators. This 
type of assessment has important advantages and will serve as a basis for self- 
renewal.' This activity contains three sub-activities which are as followsr 

Sub-Activity XII-1— Selection of the Evaluation Team 

The Board of Directors of V-TECS will select a qualified low bidder as a 
thir^d' party evaluator from states or organizations outside the membership to 
evaluate and make recommendations concerning the tonal organization and its 
procedures. This evaluation shall occur within the first two years of the opera- 
tion and every two years thereafter. The Board of Directors selects and employs 
the evaluators and sets guidelines for their study. These guidelines will be' 
used as a basis for developing a well defined and congruent request -for proposals. 
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Sub-Ac tlvlty XII-2 — The Evaluation and Report of Results 

The evaluation is conducted by a team .selected by^ the Board of Directors. 
The chairman of the evaluation team will be selected by the successful bidder 
and the members of the evaluation team.' The results of the evaluation are 
forwarded to tlfe Chairman of the Board of Directors of V-TECS with a copy, 
transmitted concurrently to the Director of the Southern Asisociation of Colleges 
and Schools, the Executive Secretary of the Commission on Occupational Education 
Institutions, and the Executive Director of V-TECS. 

Sub-Activity XII-3 — Implementation of the Re commendia t ions of the Evaluation 

The Board of Directors :of V-TECS reviews the evaluation results and directs 
the implementation of the recommended changes as it deems necessary and expedient. 
The administering agency files its response to the Board of Directors for con- 
sideration prior to implementation of recommendations made by ^the. evaluation . 




Master Sequence Chart fdr the Phase Model 
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PHASE . 1 MODBi; FOR .USE. ; ' < , ^ 

BY THlP'^V0CATI0NAL-T5C^^^ : . 
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MEASURES IN OQCUPATION^AL EDUCAtiIDN " ^ ; 
-J • . ■ ; ' ; ' ^ - -'//.'^ > 

JUlftf OF ^EXPERTS. . ^ , , ^ V' . / . ' 



Mr. Ray Barber r Director 

Division of Occupational Re^searyh ari,^ 

Development - ; 
T^xas Education Agency 
201 East Eleventh Street 
Austin^ Texas 78701 

Dr. Ga3T^ F. Beasley/ Technical Coordinator^ ^ 
Hississxppi State University • 
Research Coordinating Unit for ^ v 

Vocational-Technical Education/ 
P. O. Drawer DX ' ' 

State College/ Mississippi' 39762 . 

Dr.' Gene Bottoms^ Director 

Division of Program and Staff Development 

Division bf Vocational Education 

State Deppirttnent of Education 

State Office Buildinfa . 

Atlamita/ Gedrgist 3ffl334~™; — - 

Dr. Wendell Bruce ^ Director 

Division of Vocational Program Management 

State Department of Education 

Frankfortr Kentucky 40601 ^ 

Lt4 Col. R. N. Culbertson, Chief 

Liaison Division - Stop 28 ^ 

Community College of the Air Force 

Randolph Air Force Base^ Texas 78148 

Dr. Walter E. Driskill,' Chief 
Occupational -Career Development Branch 
Occupational Measurement Squadron 
Lackland Air Force Base^ Texas 
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Mr. Charlie M» Dunn^ Dean of J^truction^^^^^^ ' 
Nashville State Tedhnical lasiitute: 
120 White Brld(^e Road C 
NaWhville/ Texihessea 3720^ 

Dr Kenneth M. fiaddy ^ Administrator 

Bureau of Vocational Research and Evaluation 

Division of yocationaly Technical r and 

Adult Education 
Florida Department of Educaftion 
Tallahasseer Florida 32304 

. - ■ . ■ ■■ • 

Dr. Clifford EaiMion iF. 
Private Educatjj^^fial Consultan 
75 Blanchard Iteiad 

South Weymouth r Massachusetts 03190 

(Jr. W.^ H. Fitz r Education Programs Director 
Office o^ the Deputy .Associate Coiwnissioner 
for becupat4.brial Education and Technology 
Itexas Education . Agency 
201 East Eleventh Street * 
Austin r Texas 78701 

Dr. Roy GiehlSr Consultant 

Bureau of Vocational Research and Evaluation 

Function 
Florida Department of Education 
Tallahassee, Florida 32304 

Mr; H Gregory, Curriculimi Specialist 

Comprehens ive Vocational Education 
243 Cordell Hull Building .t: 
NFash vil le , Tennes see 3 7219 

Dr. Wallace H. Hannum, Assistant Professor 
Department of Educational Research 

and Center for Educational Technology 
Florida State University ' 
415 North Monroe Street 
Tallahassee, Florida 32 301 

Mr. Toin L. Hindes, Director 
Instructional Materials Laboratory 
Trade and Industrial Education 
The Ohio State University 
1885 Neil^ Avenue 
Columbus, Ohio 43210 
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Dr. jdhn j. Keeigan> Siajjitr^^ 
Evaluation aiid Program Unit ^ 
Salem Publip Schoplti 

Salemr Oregon 97302 ' '^■^'''' ■iKi':^' 

Mr . James. Kendrickv Curriquli^ Specialist: 

; state depciirtiiiexit pf : -Educsrt^ipii < ^ 
^:State Officse.etiilding-^ fr;-^ 
Mpnt^gp^ry^^^^^M 36104 ; ^ 

MSgfi • - Bil ly j. Kpscheski Curfidu 
Qjmmunit]i(^ College of tJlie Air Poj^ce^ ^ 

Lt. Blaine Lee, Curriculmn Specialist'. ^^^^ 
170© B Rockbridge Tierrade • . 
Austin, Texas 78?41 \ , ^ 

Dr. iieon M. Lessinger, Dean 
Cpllege of Educati6n : .^^^^^^^r , / ^ 

. uh;Lvfersity of South Carolina : ' ^ 

Coltimbia, South Carolina 29208 > -^^^^ 

Mr. James Marable, Head ^ 
Data Processing Technology Department 
Nashville State Technical Institute 
•120 White Bridge Road - 
Nashville, Tennessee 37209 [ - 

Ml:. Ronald Weeks, QiSisctor, 
. Curriculupt . 
Division of VQcat|||kal-Technical 

Educfiation i 
151S West Sixth Street ^ ^ 1 

Stillwater, Oklahoma 74074. 

Mr. Mike Ni SOS, Managing Director 
Aerospace Education Foundation * ■ ■ 
1750 Pennsylvania Avenue NW ♦ 
Washington, D.C. 20006 

Dr. George L, O'Kelley, jr.. Chairman 
Division of Vocational Education 
College of Educat^-dn ' 
Uhive^rsity of Georgia 
Athens, Georgia 30601 
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Dr. J. paXe Oliyer, Director ;^ " « * 

Vocational BaiiCation Evalqjii^ioii Project' ^ i , , •. 
Diviaipw of Vocational Jina ""TeObnical Education 
Virjginia Polytacjinio Institute, ,ai^» Stj^te U»i Varsity. 

.Black«bur^ yirgiM«i^ii^4Wi^,'-v-'Hr:'>\. ^ < * " - ,> 

^ihr. Bill Seitz, PJjuniihg SiJfc^jl^t i ' « 

State Technical t^i*ute*. .' ' , . 



^Division of VOcatiiial , Tj^O 
Higher BdvfOation - 
State bffibe.Biiilding ; t t 
Montgomery, Alabama 36104 » 

te, Charles Kogera, Director 
(^cupational Redearph Unit / , ' 
Departa^nt of ,Publdc instruction > 
^tate Department of £ducat:ioti 
State Of ficef Building . 
Raleiah. North Carolina 27611 
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Hr. Paul Scott, Director ;/ . / 

Occupational Research Coordinating Unit ' ^ 
State Depa:^tment of Education , . - 
Room ?50 . . 

State Office Building 
Atlanta, Georgia 30334 

Dr; James W. Selman, Associate Professor 
College of Education 
univerlaity of South Florida 
Taiapa, Florida 33620 

Dr.^'ISienn C;, 'Shinn> Associate Frofessoif- 
university of Missouri";<:ol\ambia 
"College Of Agriculture' 
100 Agriculture Engineering .Building , 
Columbia, Missouri 65201 ^ 

Mr. Robert Spillman, Coordinator 

Career Education Curriculum Development Center 

Department of Vocational Education 

University of Kentucky 

Lexington, Kentucky 40506 

.' y 

Miss Ruth Stovall, Branch Director 
Program Services 

Division of Vocational, Technical, and. 

Higher Education » 
State Office Building 
Montgomery, Alabama 36104 



Miss Gail Trapnell, AMMt^^«-^<^T^^^trat6r/an 

Area 1 Supervisor 
Distributive Education 
State of Florida 
Tallahass^e> Florida 32304- - / 

Dr. Jairtfeis E. Wali^ Director 
Curriculum 5ind Coordinating Units 
Mississippi State Univ^ratiy 
State College^ MiiSlsiss^pi 39762 

Dr. Charles F.^^Waydr Mian rv' 
School^ . of Applied Sciences and Technology 

Mprehead state University ' \. ; 

Mb^hea;d, Kentucky 4Q 351 . 

Br^ Rayniqnd W^asdyke y Assq^ -Examiner 
Eldueational Testing Seryice 

Princeton, New Jersey- 08540 > ' ; 

' ' ' ' - " '■ • • ■' ■ J. ' ■ . . ^ "■ ^''V 

Hr ^ William F., Wieser/*Inst ^ ' v 

9oh661 of Education \ * ^ ' ^ 

1714 S. W. "A" Street ; . 

Oregon Stite University / . C 
CorvalliSr bregonl 97330 
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Instructional System 
Design Conference 




IMS 



USAF School of Applied Aerospace Sciences, Keesler 
Keesler AFB, Biloxi, Missbsippi 




OCTOBER 9-12, 1973 



C o s p o n s o r e d b y 
THE SOUTHERN ASSOCIATION bF COLLEGES AND SCHOOLS' 
COMMISSION ON OCCUPATIONAL EDUCATION INSTITUTIONS 
VOCATIONAL TECHNICAL EDUCATION CONSORTIUM OF STATES 

AND THE ^ 
4,, COMMUNITY COLLEGE OF THE AIR FORCE 



^ATC keesU'i'H- 976 
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CONFERENCE CHAIRMAN: BOB CHILDERS 
Executive Secretary, Commission on Occupational Education Institutions 
Southern Association of Colleges and Schools 



I 
I 



TUESDAY. OCTOBER 9 

8:00 aim. RegistraSon and Coffee 
Lobby - Ramada Inn 

9:00 a.m. Welcome 

BRYAN M. SHOTTS, Major 
General/USAF, Center 
Commander, Keesler AFB 

9:10 a.m. '^The Relationship 
of Performance -Based 
Objectives to Accounpability 
in Education" 
JOHN L. PHIPPS, Colonel, 
USAF, Presh^rit, Community 
College of the Air Force 

9:40 a.m. ''Performance -Based 
Objectives: Boon to Educa- 
dbn" 

FELIX C. ROBB 
Director, Southern Assoc- 
iation of Colleges and 
Schools 

10:10 a.m. Coffee Break 

10:30 a.m. "Why Use Performance- 
Based Objectives?" 
LEON M. LESSINGER 
Dean, College of Education 
University of South Carolina 



11:30 a.m. Lunch 

1:00 p.m. Films 

"Instructional System 
Development: The Process" 
"Criterion Objectives: Key 
to Success" 

1:45 p.m. "The Air Force 

Occupational Research Pro- 
gram" 

RAYMOND E. CHRISTAL 
' Personnel Research Divis- 
ion, Lackland AFB 

3:15 p.m. Break 

3:30 p.m. "Using Information 
Revealed by the Occupation- 
al Analysis" 
WALTER E. DRlSKILL 
Occupational Measurement 
Squadron, Lackland AFB 

^ 

6:00 p.m. Social Hour 

Conference P&itlcipants 
Officers' Club - Keesler 
AFB 



WEDNESDAY, odlOBEltlp 

9:00 a.m. Seminars .\ 

"From Occupational AnalysiF 
to Performance -Based Ob|M 
tives: The Critical Trans- 
ition" 

10:15 a. m. Break 



I 
I 

I 



10130 a.m. Seminars 

"How Are Criterion Measures 
Developed Which Will EvalU'^ 
ate Attainment of the Ob|ec-l 
' tlves?" . ■ 

11:30 a.m. Lunch 



I 



1:00 p.m. Presiding: 

ROBERT SHLLMANr • 
Chairman, Board of Direc-- ■ 
tors. Vocational -Technical! I 
Edycation Consortium of | 
States ^ 0 I 

"Selection of Materials To | I 

Da The Job" « | , 



I 



"Consortium Assistance in 
Procurement <A Materials" 
BEN A. HIRST, JR. 
Project Director, Commis- « 
sion on Occupational Educa-I 
tion Instltutiohs ' 



THE SPEAKERS 



I 



Raymond E. Christal is Chief* Occupational and 
Career Development Branch. Personnel Research 
Division* Air Force Human Resources Laboratory. 
He designed a complex set of computer programs 
*(CODAP) used for analyzing and reporting oc 
cupational information within the. Air Force. He 
has served in a variety of capacities, with 
governmental agencies, including directing 
construction of Air Force Officer Qualification 
Tests, developing tests used in selecting the first 
astronauts, and co-developing application of a 
mathematical model for grouping elements into 
mutually exclusive clusters. 

Walter E. Driskill is Chief » Occupational Career 
Development Branch, Occupational Measurement 
Squadron, Lackland Air Force Base* Texas. He has 
held various secondary and post-secondary teach* 
ing positions in the civilian community. In-l056 he 
began his civil service career with the Air Force, 
subsequently serving as an employee relations oi" 
ficer, test and measurement^peciali^t, and most 



recently as Technical Director of the Air Force oo*^ 
cupational analysis program. 

Leon M. Latsinger Is Dean of the College of| 
Education of the University of South Carolina. He 
is a licensed clinical psychologist and has been a 
teacher, administrator, research consultant* andl 
Associate U. S. Commissioner for Elementary aiid| 
Secondary Education. He serves as President of 
the Aerospace Education Foundation. Amonff 
many publications* he is the author oiEveryKXdm\ 
V/inner az^cl editor of Accountability in EducatioD, 

John L. Phipps is President. Community College Of 
the Air Force. A native of Dallas. Texas. Colonel 
Phipps entered the Air Force in 1951. Early in blaLi 
career he held various instructor positions ranger 
ing from electronics to navigation. While serving 
as Education and Training Staff Officer at Head- 
quarters USAF he was instrumental in foundingi 
the Air Force Human Resources Laboratory andl 
Instructional Technology organizations in the! 
J^entagon. In recent years he has worked as ia 
research psychologist/systems analyst and has. 
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I "Materials Available Through 
• Communliy College of the Air 
Torce" 

I BILLY J. KOSCHESKI, MSgt, 
USAF, Curriculum Advisor, 
Community College of the 
Air Force 

f "Materials Available Through 
the Aerospace Education 

I Foundation" 
JAMES H. StRAUBEL 
Executive Director, Aero- 
space Education Foundation 

jsp.m. Break 

[X) p,m. "Construction of 

(Materials Using the Principles 
of Instructional System Devel- 
opment" 

BLAINE E. LEE, 1st Lt, USAF 
Instructional System Staff 
Officer 

v. 

r RICHARD A. MOON, SMSgt, 
USAF, instructional System 
Monitor 



THURSDAY. OCTOBER II 

9:00 a.m. Visits to Training 
Sites - Keesler AFB . . 

Electronics Principles 

Personnel and Admlnlstra- 
tlon Principles 

Pefcionnel Specialist On -The- 
Job Training (Computer - 
Assisted Instruction) 

Airborne Radio Communica- 
tions 

11:30 a.m. Lunch 

1:00 p.m. Visits to Training 
Sites - (Cont'd) 



FRIDAY, OCTPBER 12 

9:00 a.m. "Evaluation of Courses 
• Developed Under the Instruc- 
tional System Concept" 
BILL M. JINKS 
Chief, Evaluation Division 

DENNIS JORDAN 
Training Specialist^ 
Curriculum Control 
Keesier AFB 

10:00 a.m. Break 

10:15 a.m. "Performance -Based 
Instruction: Implications 
For The Future" 
WILUAM F. HERCE 
Deputy Commissioner for 
Occupational and Adult 
Education ^ 

U.S. Office of Education 

11:00 a.m. Closing Remarks and 
Adjournment 



lerved as a consultant to various govemment 
igenoiea. 

N\Ulmn F. Pierce is Deputy Commissioner for Oc- 
nipational and Adult Education, U. S. Office of 
Education. He brings to this office a rich 
Mokground in occupational education* having 
isen through the ranks in the Michigan 
^•paitment o/ Education (1964-73) while serving 
\M consultant and as supervisor of manpower and 
Uvelopment training programs. He has served as 
)9puty Superintendent of Public Instruction, 
iflohigan Department of Education. Prior to this 
1968-64) he gained experience as a part-time 
Qstructor and graduate assistant. College of 
Cduoiktioii, Michigan State University, subsequen- 
ly ritin^pto the position of Assistant Coordinator 
>t Student Teachers. 

C. ' Robb is Director of the Southern As- 
oolatlon of Colleges and Schools^ His career 
•g»n as a public school teacher later shifting to 
liat of a 9oUege instructor. Subsequently* he held 
> variety of academic administrative posts before 



being named President of Peabody College. He has 
initiated for our government a program of 
educational and technical assistance in the 
Republic of Korea. His deep Interest in 
international understanding has taken him to 
Europe and back to the Orient on special missions. 
A noted author and speaker. Dr. Robb has long 
been involved in educational* civic, and religious 
activities. He is a protagonist of the New South 
and an outspoken proponent of education's res- 
ponsibility to help maintain and expand freedom. 

Jamet H. Straubel is Executive Director of the Air 
Force Association and the Aerospace Education 
Foundation. He is publisher of Air Force Magazine 
*and editor of The Official Ouide to the Army Air 
Forces and Air Force Diary, Films he has written 
and "produced include **The Real Revolution in 
Education.'* He has created and directed hundreds 
of seminars dealing with the impact of aerospace 
technology on modem society, including more 
than 150 specifically dealing with our educational 
requirements. 
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ATTACHMENT "IS' 




SOUTHERN ASSOCIATION OF COLLEGES AND SCHOOLS 
795 Peachtree Street, N.E. • Atlanta, Georgia 30308 

P}ione 875-8011 Area Code 404 . . 

i 

VOCATIONAL-TECHNICAL EDUCATION CONSORTIUM OF STATES . 

The Role of the Technical Coordinator in the State, . 

The technical coordinator in each state belonging to the 
Consortium has two primary functions. which are: (1) to act as 
a liaison between the state projects and ihe Consortium staffs 
and (2) to serve as a technical resource person for project 
personnel within the state. The technical coordinator has a 
key role in the success of projects in a particular state* 
The preparation and training of this person is vital to the 
proper functioning of the Consortium and, in particular, the 
activities within the state. Administratively, the technical 
cpordinators are responsible to. an administrator in the state 
but are expected to be responsive to the Consortium staff* 
For this reason the responsibilities are delineated as follows: 

I. Duties and Responsibilities Within the ^tate 

Within the state, the^ technical coordinator provides ^ 

the services and performs the functions as follows: 

(1) Monitors projects which are developing catalogs 

of performance objectives and criterion-referenced measures 

in accordance with the Memorandum of Agreement. 

0 
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(2) Serves as a resource person for^ project personnel 
within the state during Domain Stud^ activities^ 

(3) Reviews all reports and products developed within 

the state to assure that quality criteria have been met. 

*■ 

(4) Supervises the survey of incumbeiit' workers '(follow-up 
activities only) inside the state to assist in obtaining 
adequate responses to the task list booklet. ^ 



CS) Serves as a resource person for the interpretation 



of task analysis data to personnel within the state. 



(6) Assists in the preparation and training of personnel 
sei^ving on writing teams to convert task analysis data and 
task statejnents to performance objectives, 

(7) Provides technical assistance tO' project directors 
so that products are delivered on time and meet acceptable 
quality standards. 

(8) Provides technical advice and assistance t:(/<^personnel 
in the state during the field test» field utilization studies 
and, implementation phases of the catalogs. 
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(9) ^sists in the development of the state's dissemination 
plan and in-service training plan for implementing the use of 
the catalogs of performance objectives ^nd criterion-referenced 
mea|pres« 

t> 

II. ^Responsiveness to the Consortium Staff ^ 

The Consortiiira staff ha? a technical specialist whose 
primary responsibility is to work with and assist the technical 
coordinators in the member states* The working relationship 
of these people must be rather close so that an acceptable 
quality level of products, /^raining of personnel, and procedures 
used to develop catalogs can be maintained. In view of these 
key items the technical coordinators in each state are expected 
to be responsive to the Consortium staff as follows: 

(1) "Parrtc^iiy)arte in--all training programs, seminars, and 
conferences developed and conducted by the Consortium. 

(2) Attends other specialized trarjjjfc|^«siwi^s»,..-^^ 
conferences, and seminars pTescribedTby t^'f^rd of Directors 
of the Consortium, 

f31 Serves as a technical resource person to projects 
within the state anrd makes necessary reports required under 
provisions of the /Memorandum of Agreement. 
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(4) Reviews all ^reports and products produced in^ the 
state through its project efforts prior to submitting to the 
Consortium staff. 

(5) Provides periodic progress reports of projects to . 
the Consortium staff at intervals set by the Board of Directors 
of the Consortium, ' 




# 



78 



APPENDIX "F" 
Schedule and Sequence Chart 
for the 
Memorandum of Agreement 



VOWTIONAL-TECHNICAL EDyCATlON CONSORTIUH OF STATES. 

SCHEDULE AND^siuENCE CHART FOR THE MEMORANDUM OF AGREEMENT 



8TAT& OP ART STUDY 



TASK LIST BOOKLET 



REPORT OP DOMAIN 
STUDY 

COMPLETED SURVEY 



ANALYSIS 

SELECT WRITING TEAM 
PEPORT WRITING TEAM 
FIELD TEST VERSION 
FIELD TEST 
FINISHED CATAMX5 

DAYS 




0 - ifi., ' 90 120 150 180 210 240 270 



^- product or report delivery 



